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Digital signal processing techniques have become the method of choice in signal process- 
ing as digital computers have increased in speed, convenience, and availability. As 
microprocessors have become less expensive and more powerful, the number of DSP ap- 
plications which have become commonly available has exploded. Thus, some DSP 
microprocessors can now be considered commodity products. Perhaps the most visible 
high volume DSP applications are the so called “multimedia” applications in digital 
audio, speech processing, digital video, and digital communications. In many cases, these 
applications contain embedded digital signal processors where a host CPU works in a 
loosely coupled way with one or more DSPs to control the signal flow or DSP algorithm 
behavior at a real-time rate. Unfortunately, the development of signal processing algo- 
rithms for these specialized embedded DSPs is still difficult and often requires special- 
ized training in a particular assembly language for the target DSP. 

The tools for developing new DSP algorithms are slowly improving as the need to 
design new DSP applications more quickly becomes important. The C language is prov- 
ing itself to be a valuable programming tool for real-time computationally intensive soft- 
ware tasks. C has high-level language capabilities (such as structures, arrays, and func- 
tions) as well as low-level assembly languag e capabilities (such as bit manipulation, 
direct hardware input/output, and macros) which makes C an ideal language for em- 
hedded DSP. Most of the manufacturers of digital signal processing devices (such as 
Texas Instruments, AT&T, Motorola, and Analog Devices) provide C compilers, simula- 
tors, and emulators for their parts. These C compilers offer standard C language with ex- 
tensions for DSP to allow for very efficient code to be generated. For example, an inline 
assembly language capability is usually provided in order to optimize the performance of 
time critical parts of an application. Because the majority of the code is C, an application 
can be transferred to another processor much more easily than an all assembly language 
program. 

This book is constructed in such a way that it will be most useful to the engineer 
who is familiar with DSP and the C language, but who is not necessarily an expert in 
both. All of the example programs in this book have been tested using standard C compil- 
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ers in the UNIX and MS-DOS programming environments. In addition, the examples 
have been compiled utilizing the real-time programing tools of specific real-time embed- 
ded DSP microprocessors (Analog Devices’ ADSP-21020 and ADSP-21062; Texas 
Instrument’s TMS320C30 and TMS320C40; and AT&T’s DSP32C) and then tested with 
real-time hardware using real world signals. All of the example programs presented in the 
text are provided in source code form on the IBM PC floppy disk included with the book. 

The text is divided into several sections. Chapters 1 and 2 cover the basic principles 
of digital signal processing and C programming. Readers familiar with these topics may 
wish to skip one or both chapters. Chapter 3 introduces the basic real-time DSP program- 
ming techniques and typical programming environments which are used with DSP micro- 
processors. Chapter 4 covers the basic real-time filtering techniques which are the corner- 
stone of one-dimensional real-time digital signal processing. Finally, several real-time 
DSP applications are presented in Chapter 5, including speech compression, music signal 
processing, radar signal processing, and adaptive signal processing techniques. 

The floppy disk included with this text contains C language source code for all of 
the DSP programs discussed in this book. The floppy disk has a high density format and 
was written by MS-DOS. The appendix and the READ.ME files on the floppy disk pro- 
vide more information about how to compile and run the C programs. These programs 
have been tested using Borland’s TURBO C (version 3 and greater) as well as Microsoft C 
(versions 6 and greater) for the IBM PC. Real-time DSP platforms using the Analog 
Devices ADSP-21020 and the ADSP-21062, the Texas Instruments TMS320C30, and the 
AT&T DSP32C have been used extensively to test the real-time performance of the 
algorithms. 

ACKNOWLEDGMENTS 

I thank the following people for their generous help: Laura Mercs for help in preparing 
the electronic manuscript and the software for the DSP32C; the engineers at Analog 
Devices (in particular Steve Cox, Marc Hoffman, and Hans Rempel) for their review of 
the manuscript as well as hardware and software support; Texas Instruments for hardware 
and software support; Jim Bridges at Communication Automation & Control, Inc., and 
Talal Itani at Domain Technologies, Inc. 

Paul M. Embree 

TRADEMARKS 

IBM and IBM PC are trademarks of the International Business Machines Corporation. 
MS-DOS and Mircosoft C are trademarks of the Microsoft Corporation. 

TURBOC is a trademark of Borland International. 

UNIX is a trademark of American Telephone and Telegraph Corporation. 

DSP32C and DSP3210 are trademarks of American Telephone and Telegraph Corporation. 
TMS320C30, TMS320C31, and TMS320C40 are trademarks of Texas Instruments Incorporated. 
ADSP-21020, ADSP-21060, and ADSP-21062 are trademarks of Analog Devices Incorporated. 



CHAPTER 



Digital Signal Processing 
Fundamentals 



Digital signal processing begins with a digital signal which appears to the computer as a 
sequence of digrtal values. Figure 1.1 shows an example of a digital signal processing op- 
eration or simple DSP system. There is an inpu t sequence x(n), the operator O f } and an 
output sequence^yln). A complete digital signal processing system may consist of many 
operations on the same sequence as well as operations on the result of operations. 
Because digital sequences are processed , all operators in DSP ^ 

(as opposed to continuous time operators employed by analog systems). Discrete time op- 
erators may be classified as tir^vary’ing oT timedflvariant and linear or nonlinear. Most 
o the operators described in this text will be time-invariant with the exception of adap- 
live filters which are discussed in Section 1.7. Linearity will be discussed in Section 1.2 
and several nonlinear operators will be introduced in Section 1.5. 

Opera tors are applietLto sequences in order to effect the following results: 

(1) Extract parameters .or features from the sequence. 

( 2 ) Produce a similar sequence with particular features enhanced or eliminated. 

(3) Restore th e sequ ence to some earlier state. 

( 4 ) Encode or compress the sequence. 

This chapter is divided into several sections. Section 1.1 deals with sequences of 
numbers: where and how they originate, their spectra, and their relation to continuous 
signals. Section 1.2 describes the common characteristics of linear time-invariant opera- 
tors which are the most often used in DSP. Section 1.3 discusses the class of operators 
called digital filters. Section 1.4 introduces the discrete Fourier transform (DFTs and 
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x(n) 

...x(2), x(1), x(0) 



DPS Operation 




y(n) 

■ 1). y(0) 



FIGURE 1.1 DSP operation. 

FFTs). Section 1.5 describes the properties of commonly used nonlinear operators. 
Section 1 .6 covers basic probability theory and random processes and discusses their ap- 
plication to signal processing. Finally, Section 1 .7 discusses the subject of adaptive digi- 
tal filters. 



1.1 SEQUENCES 

In order for the digital computer to manipulate a signal, the signal must have been sam- 
pled at some interval. Figure 1.2 shows an example of a continuous function of time 
which has been sampled at intervals of T seconds. The resulting set of numbers is called a 
sequence. If the continuous time function was jc(f), then the samples would be x(nT) for n, 
an integer extending over some finite range of values. It is common practice to normalize 
the sample interval to 1 and drop it from the equations. The sequence then becomes x(n). 
Care must be taken, however, when calculating power or energy from the sequences. The 
sample interval, including units of time, must be reinserted at the appropriate points in the 
power or energy calculations. 

A sequence as a representation of a continuous time signal has the following impor- 
tant characteristics: 



m 




£ 




( 1 ) 

( 2 ) 

(3) 



The signal is sampled. It has finite value at only discrete points in time. 

The signal is truncated outside some finite length representing a finite time interval. 
The signal is quantized. It is limited to discrete steps in amplitude, where the step 
size and, therefore, the accuracy (or signal fidelity) depends on how many steps are 
available in the A/D converter and on the arithmetic precision (number of bits) of 
the digital signal processor or computer. 



In order to understand the nature of the results that DSP operators produce, these 
characteristics must be taken into account. The effect of sampling will be considered in 
Section 1.1.1. Truncation will be considered in the section on the discrete Fourier trans- 
form (Section 1.4) and quantization will be discussed in Section 1.7.4. 

1.1.1 The Sampling Function 



The sampling function is the key to traveling between the continuous time and discrete 
time worlds. It is called by various names: the Dirac delta function, the sifting function, 
the singularity function, and the sampling function among them. It has the following 
properties: 



Property 1 . 


[/(r)6(t-tVt = /(x). 


(1.1) 


Property 2. 


\h - x)dt = 1. 


(1.2) 



In the equations above, x can be any real number. 

To see how this function can be thought of as the ideal sampling function, first con- 
sider the realizable sampling function, A(/), illustrated in Figure 1.3. Its pulse width is one 
unit of time and its amplitude is one unit of amplitude. It clearly exhibits Property 2 of 
the sampling function. When A(t) is multiplied by the function to be sampled, however, 
the A (t) sampling function chooses not a single instant in time but a range from to 
+V 2 . As a result. Property 1 of the sampling function is not met. Instead the following in- 
tegral would result: 



£/(f)A(t- x)dt = f x + lfU)dt. (1-3) 

This can be thought of as a kind of smearing of the sampling process across a band which 
is related to the pulse width of A(r). A better approximation to the sampling function 
would be a function A (t) with a narrower pulse width. As the pulse width is narrowed, 
however, the amplitude must be increased. In the limit, the ideal sampling function must 
have infinitely narrow pulse width so that it samples at a single instant in time, and infi- 
nitely large amplitude so that the sampled signal still contains the same finite energy. 

Figure 1.2 illustrates the sampling process at sample intervals of T. The resulting 
time waveform can be written 
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x s (t)= ^xm'-nT). (1.4) 

n-~<> o 

The waveform that results from this process is impossible to visualize due to the infinite 
amplitude and zero width of the ideal sampling function. It may be easier to picture a 
somewhat less than ideal sampling function (one with very small width and very large 
amplitude) multiplying the continuous time waveform. 

It should be emphasized that xs(t) is a continuous time waveform made from the su- 
perposition of an infinite set of continuous time signals x(f)5(r - nT). It can also be writ- 



x s (t)= ^x(nT)8(t - nT) (1.5) 

n =- oo 

since the sampling function gives a nonzero multiplier only at the values / = nT. In this 
last equation, the sequence x(nT) makes its appearance. This is the set of numbers or sam- 
ples on which almost all DSP is based. 

1.1.2 Sampled Signal Spectra 

Using Fourier transform theory, the frequency spectrum of the continuous time wave- 
form x(t) can be written 




x m = j~j(t)e- j2nf, dt 



( 1 . 6 ) 
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and the time waveform can be expressed in terms of its spectrum as 

*(') = £• X(f)e J2 *df. (1.7) 

Since this is true for any continuous function of time, x{t), it is also true for xft). 

x s(f) = j^x s (t)e~ J2vfi dt. (1.8) 

Replacing xft) by the sampling representation 




^xOM-nT) e- J2nfi dt. 



(T9) 



The order of the summation and integration can be interchanged and Property 1 of the 
sampling function applied to give 



*,(/) = | \x{nT)e-^ T . (1.10) 

This equation is the exact form of a Fourier series representation of Xff), a periodic 
function of frequency having period 1/T. The coefficients of the Fourier series are x(nT) 
and they can be calculated from the following integral: 

1 

x(nT) = T^[x 2 (f)e^ T df. (1.11) 

-2T 

The last two equations are a Fourier series pair which allow calculation of either the time 
signal or frequency spectrum in terms of the opposite member of the pair. Notice that the 
use of the problematic signal x s (t) is eliminated and the sequence x(nT) can be used instead. 

1.1.3 Spectra of Continuous Time 
and Discrete Time Signals 



By evaluating Equation (1.7) at t = nT and setting the result equal to the right-hand side 
of Equation (1.1 1) the following relationship between the two spectra is obtained: 



x(nT) = ^X(f)e j2llfnT df = X s (f)e jlKfnT df. (1.12) 

-IT 

The right-hand side of Equation (1.7) can be expressed as the infinite sum of a set of inte- 
grals with finite limits 



oo 

x(nT)= Y, T [Z x( P> ej2nfnTd f- (1.13) 

m=~® o -T 
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By changing variables to X =/- mJT (substituting f = X + mIT and df= d5l) 

00 » m T 

x (nT) = ^ X(k + ~)e j2nXnT e J ’' 7 '" dk. (1.14) 

m=- 00 it 1 

Moving the summation inside the integral, recognizing that e j7nmn (for all integers m and 
n) is equal to 1, and equating everything inside the integral to the similar part of Equation 
(1.11) give the following relation: 

x s w= jr x(/+^). (us) 

m =- 00 

Equation (1.15) shows that the sampled time frequency spectrum is equal to an infinite 
sum of shifted replicas of the continuous time frequency spectrum overlaid on each 
other. The shift of the replicas is equal to the sample frequency, It is interesting to ex- 
amine the conditions under which the two spectra are equal to each other, at least for 
a limited range of frequencies. In the case where there are no spectral components of 
frequency greater than */ 2 r in the original continuous time waveform, the two spectra 



IG(f)l 



f 

(a) Input spectrum 
IG(f)l 



2 

(b) Sampled spectrum 

IG R (f)l 



FIGURE 1.4 Aliasing in the fre- 
quency domain, (a) Input spectrum. 

(b) Sampled spectrum. 

(c) Reconstructed spectrum. 
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(c) Reconstructured spectrum 
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are equal over the frequency range /= -V 27 - t of - +V 2r . Of course, the sampled time spec- 
trum will repeat this same set of amplitudes periodically for all frequencies, while the 
continuous time spectrum is identically zero for all frequencies outside the specified 
range. 

The Nyquist sampling criterion is based on the derivation just presented and asserts 
that a continuous time waveform, when sampled at a frequency greater than twice the 
maximum frequency component in its spectrum, can be reconstructed completely from 
the sampled waveform. Conversely, if a continuous time waveform is sampled at a 
frequency lower than twice its maximum frequency component a phenomenon called 
aliasing occurs. If a continuous time signal is reconstructed from an aliased representa- 
tion, distortions will be introduced into the result and the degree of distortion is depen- 
dent on the degree of aliasing. Figure 1.4 shows the spectra of sampled signals without 
aliasing and with aliasing. Figure 1 .5 shows the reconstructed waveforms of an aliased 
signal. 



9(0 

t 

(a) Input continuous time signal 
9(0 

f 

(b) Sampled signal 
9ff) 

t 

FIGURE 1.5 Aliasing in the time 
domain, (a) Input continuous time 
signal, (b) Sampled signal. 

(c) Reconstructed signal. 






(c) Reconstructed signal 
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1.2 LINEAR TIME-INVARIANT OPERATORS 

The most commonly used DSP operators are linear and time-invariant (or LTI). The lin- 
earity property is stated as follows: 

Given x(n), a finite sequence, and 0{ }, an operator in n-space, let 

y(n) = 0{x(n)}. (1.16) 

If 

x(n) = ax t (n) + bx 2 (n) (1.17) 

where a and b are constant with respect to n, then, if C{ } is a linear operator 

y(«) = £?C{x 1 (w)} + iO{jc 2 (n)}. (1.18) 

The time-invariant property means that if 

y(n) = CMn)} 

then the shifted version gives the same response or 

y(n-m) = 0{jc(n-m)}. (1.19) 

Another way to state this property is that if x(n) is periodic with period N such that 

x(n + N) = x (n) 

then if 0{ } is a time-invariant operator in n space 

Cjr(n + W)) = Or(n)}. 

Next, the LTI properties of the operator 0{ } will be used to derive an expression and 
method of calculation for 0{x(n)}. First, the impulse sequence can be used to represent 
x(n ) in a different manner. 



This is because 



x(n)= x(m)u 0 (n - m). 

m=-«> 

{ 1, n = m 
0, otherwise. 



(1.20) 



( 1 . 21 ) 



The impulse sequence acts as a sampling or sifting function on the function x(m), using 
the dummy variable m to sift through and find the single desired value x(n). Now this 
somewhat devious representation of x(n) is substituted into the operator Equation (1.16): 
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y(n) = Cj ^x(m)« 0 (n-m)|. (1.22) 

Recalling that C{ ) operates only on functions of n and using the linearity property 

y(n)= ^ x(m)6 {u 0 (n - m) } . (1.23) 

Every operator has a set of outputs that are its response when an impulse sequence is ap- 
plied to its input. The impulse response is represented by h(n) so that 

/i(n) = O{« 0 (n)J. (1.24) 

This impulse response is a sequence that has special significance for 0{ }, since it is the 
sequence that occurs at the output of the block labeled €{ } in Figure 1.1 when an im- 
pulse sequence is applied at the input. By time invariance it must be true that 

h(n — m)= C{« 0 (n — m)) (1.25) 

so that 



y(«)= x(m)h(n-m ). (1.26) 

m~~o o 

Equation (1.26) states that y(ri) is equal to the convolution of x(n) with the impulse re- 
sponse h(n). By substituting m = n~p into Equation (1.26) an equivalent form is derived 

y(n)= £ h{p)x{n-p ). (1.27) 

P=^° 

It must be remembered that m and p are dummy variables and are used for purposes of 
the summation only. From the equations just derived it is clear that the impulse response 
completely characterizes the operator 0{ } and can be used to label the block representing 
the operator as in Figure 1.6. 




FIGURE 1.6 Impulse response repre- 
sentation of an operator. 
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1.2.1 Causality 

In the mathematical descriptions of sequences and operators thus far, it was assumed that 
the impulse responses of operators may include values that occur before any applied 
input stimulus. This is the most general form of the equations and has been suitable for 
the development of the theory to this point. However, it is clear that no physical system 
can produce an output in response to an input that has not yet been applied. Since DSP 
operators and sequences have their basis in physical systems, it is more useful to consider 
that subset of operators and sequences that can exist in the real world. 

The first step in representing realizable sequences is to acknowledge that any se- 
quence must have started at some time. Thus, it is assumed that any element of a se- 
quence in a realizable system whose time index is less than zero has a value of zero. 
Sequences which start at times later than this can still be represented, since an arbitrary 
number of their beginning values can also be zero. However, the earliest true value of any 
sequence must be at a value of n that is greater than or equal to zero. This attribute of se- 
quences and operators is called causality, since it allows all attributes of the sequence to 
be caused by some physical phenomenon. Clearly, a sequence that has already existed for 
infinite time lacks a cause, as the term is generally defined. 

Thus, the convolution relation for causal operators becomes: 

y(n) = jr h(m) x(n-m). (1 .28) 

/n=0 

This form follows naturally since the impulse response is a sequence and can have no 
values for m less than zero. 

1.2.2 Difference Equations 

All discrete time, linear, causal, time-invariant operators can be described in theory by 
the /Vth order difference equation 

N - 1 N - 1 

X a ^ n - = X b pX(' n ~ P) U-29) 

m=0 p-0 

where x{n) is the stimulus for the operator and y(n ) is the results or output of the operator. 
The equation remains completely general if all coefficients are normalized by the value 
of a 0 giving 

N - 1 N - 1 

y(rc) + a m y(n - m) = ^ b p x(n - p) (1.30) 

m=l p= 0 

and the equivalent form 

iV-l v-i 

y{n) = £ b p x(n - p) - £ a m y(n - m) 

p~ 0 m - 1 



(1.31) 
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y(n) = b 0 x(n ) + b,x(n - 1) + b 2 x(n - 2)... 

+ bu^xin - N + 1) - a x y(n - 1) - a 2 y(n - 2) (1 .32) 

-...-a N _iy(n- N+l). 

To represent an operator properly may require a very high value of N, and for some com- 
plex operators N may have to be infinite. In practice, the value of N is kept within limits 
manageable by a computer; there are often approximations made of a particular operator 
to make N an acceptable size. 

In Equations (1.30) and (1.31) the terms y(n - m) and x(n - p) are shifted or de- 
layed versions of the functions y(n) and x(n), respectively. For instance. Figure 1.7 shows 
a sequence x(n) and x(n - 3), which is the same sequence delayed by three sample peri- 
ods. Using this delaying property and Equation (1.32), a structure or flow graph can be 
constructed for the general form of a discrete time LTI operator. This structure is shown 
in Figure 1.8. Each of the boxes is a delay element with unity gain. The coefficients are 
shown next to the legs of the flow graph to which they apply. The circles enclosing the 
summation symbol (X) are adder elements. 



1.2.3 The z-Transform Description of Linear Operators 



There is a linear transform — called the z-transform — which is as useful to discrete time 
analysis as the Laplace transform is to continuous time analysis. Its definition is 



= " o- 33 ) 

n = 0 

where the symbol £{ } stands for “z-transform of,” and the z in the equation is a complex 
number. One of the most important properties of the z-transform is its relationship to time 



x(ri) 




012345678 



FIGURE 1.7 Shifting of a sequence. 



FIGURE 1.8 Flow graph structure of linear operators. 



delay in sequences. To show this property take a sequence, x(n), with a z-transform as 
follows: 

= X(z) = x(n)z~". (1.34) 

n=0 

A shifted version of this sequence has a z-transform: 

Ux(n-p)} = ^x(n-p)z~ n . (1.35) 

n=0 

By letting m = n-p substitution gives: 



ZWn-p) }=Y,x(m) Z - {m+p) 



(1.36) 
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= z P Y,x(m)z m . (1.37) 

m = 0 

But comparing the summation in this last equation to Equation (1.33) for the z-transform 
of x(n), it can be seen that 

ZMn ~P)} = z~ P ZWn ) ) = z~ p X(z). (1.38) 

This property of the z-transform can be applied to the general equation for LTI operators 
as follows: 




T(z) 1 + =X(z) XV' 9 • 



Finally, Equation (1.42) can be rearranged to give the transfer function in the z-transform 
domain: 







p= i 



(1.43) 



Using Equation (1.41), Figure 1.8 can be redrawn in the z-transform domain and this 
structure is shown in Figure 1 .9. The flow graphs are identical if it is understood that a 
multiplication by z _1 in the transform domain is equivalent to a delay of one sampling 
time interval in the time domain. 
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FIGURE 1.9 Flow graph structure for the 2 -transform of an operator. 



1.2.4 Frequency Domain Transfer Function of an Operator 

Taking the Fourier transform of both sides of Equation (1.28) (which describes any LTI 
causal operator) results in the following: 

T M») ) = h(m)f {x(n - m) } . (1.44) 

m— 0 

Using one of the properties of the Fourier transform 

fW»-m)) = «-^fWn)). (1.45) 

From Equation (1.45) it follows that 

Y(f)='£h(m)e- j2 ’* n X(f), 

m=0 



(1.46) 
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or dividing both sides by X(f) 



^Q-=y h(m)e~ J2 ^, 
Y(f\ Au 



which is easily recognized as the Fourier transform of the series h(m). Rewriting this equation 

j~=H(J) = r{Km)}. (1.48) 

Figure 1.10 shows the time domain block diagram of Equation (1.48) and Figure 1.11 
shows the Fourier transform (or frequency domain) block diagram and equation. The fre- 
quency domain description of a linear operator is often used to describe the operator. 
Most often it is shown as an amplitude and a phase angle plot as a function of the variable 
f (sometimes normalized with respect to the sampling rate, 1/7). 

1.2.5 Frequency Response 

from the z-Transform Description 



Recall the Fourier transform pair 



X s (f)= yx(nT)e- 



x(nT) = £Xs(f)e j2 ^ nT df. 



Linear Time Invariant 




y(ri) = X h(m) x(n - m) 

m= 0 



FIGURE 1.10 Time domain block dia- 
gram of LTI system. 



Linear Time Invariant 




Y(f) = H(f) X(f) 



FIGURE 1.11 Frequency block dia- 
gram of LTI system. 
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In order to simplify the notation, the value of T, the period of the sampling waveform, is 
normalized to be equal to one. 

Now compare Equation (1.49) to the equation for the z-transform of x(n) as fol- 
lows: 

X(z) = '£x(n)z~ n . (1.51) 

n=0 

Equations (1.49) and (1.51) are equal for sequences x(n) which are causal (i.e., x(n) = 0 
for all n < 0) if z is set as follows: 

z = e i2 *f. (1.52) 

A plot of the locus of values for z in the complex plane described by Equation (1.52) is 
shown in Figure 1.12. The plot is a circle of unit radius. Thus, the z-transform of a causal 
sequence, x(n), when evaluated on the unit circle in the complex plane, is equivalent to 
the frequency domain representation of the sequence. This is one of the properties of the 
z-transform which make it very useful for discrete signal analysis. 



P 




FIGURE 1.12 The unit circle in the z-plane. 
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Summarizing the last few paragraphs, the impulse response of an operator is simply 
a sequence, h(m), and the Fourier transform of this sequence is the frequency response of 
the operator. The z-transform of the sequence h(m), called H(z\ can be evaluated on the 
umt circle to yield the frequency domain representation of the sequence. This can be writ- 
ten as follows: 

H ^\ z=e j2Kf = H if)- (1.53) 

1.3 DIGITAL FILTERS 

The linear operators that have been presented and analyzed in the previous sections can 
be thought of as digital filters. The concept of filtering is an analogy between the action 
of a physical strainer or sifter and the action of a linear operator on sequences when the 
operator is viewed in the frequency domain. Such a filter might allow certain frequency 
components of the input to pass unchanged to the output while blocking other compo- 
nents. Naturally, any such action will have its corresponding result in the time domain. 
This view of linear operators opens a wide area of theoretical analysis and provides in- 
creased understanding of the action of digital systems. 

There are two broad classes of digital filters. Recall the difference equation for a 
general operator: 

Q - i p - l 

yW = ^ q An-q)-^a p y(.n-p). ( 1 . 54 ) 

?=o p = 1 

Notice that the infinite sums have been replaced with finite sums. This is necessary in 
order that the filters can be physically realizable. 

The first class of digital filters have a p equal to 0 for all p. The common name for 
filters of this type is finite impulse response (FIR) filters, since their response to an im- 
pulse dies away in a finite number of samples. These filters are also called moving aver- 
age (or M A) filters, since the output is simply a weighted average of the input values. 

Q - 1 

y(n) = ^b q x(n-q). (1.55) 

<7-0 

There is a window of these weights (b q ) that takes exactly the Q most recent values of 
x(n) and combines them to produce the output. 

The second class of digital filters are infinite impulse response (HR) filters. This 
class includes both autoregressive (AR) filters and the most general form, autoregressive 
moving average (ARM A) filters. In the AR case all b q for q = 1 to Q - 1 are set to 0. 

p - 1 

y(n) = x(n)-'£a p y(n-p) 

P=l 



(1.56) 
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For ARMA filters, the more general Equation (1.54) applies. In either type of HR filter, a 
single-impulse response at the input can continue to provide output of infinite duration 
with a given set of coefficients. Stability can be a problem for IIR filters, since with 
poorly chosen coefficients, the output can grow without bound for some inputs. 

1.3.1 Finite Impulse Response (FIR) Filters 

Restating the general equation for FIR filters 

e- 1 

y(n) = '^b q x(n-q). (1.57) 

«=o 

Comparing this equation with the convolution relation for linear operators 

y («) = X Km) x(n - m), 

m~ 0 

one can see that the coefficients in an FIR filter are identical to the elements in the im- 
pulse response sequence if this impulse response is finite in length. 

b q = h(q) for q = 0,1,2,3,..., Q — l. 

This means that if one is given the impulse response sequence for a linear operator with a 
finite impulse response one can immediately write down the FIR filter coefficients. 
However, as was mentioned at the start of this section, filter theory looks at linear opera- 
tors primarily from the frequency domain point of view. Therefore, one is most often 
given the desired frequency domain response and asked to determine the FIR filter coeffi- 
cients. 

There are a number of methods for determining the coefficients for FIR filters 
given the frequency domain response. The two most popular FIR filter design methods 
are listed and described briefly below. 

1. Use of the DFT on the sampled frequency response. In this method the required 
frequency response of the filter is sampled at a frequency interval of 1 IT where T is the 
time between samples in the DSP system. The inverse discrete Fourier transform (see 
section 1 .4) is then applied to this sampled response to produce the impulse response of 
the filter. Best results are usually achieved if a smoothing window is applied to the fre- 
quency response before the inverse DFT is performed. A simple method to obtain FIR fil- 
ter coefficients based on the Kaiser window is described in section 4.1.2 in chapter 4. 

2. Optimal mini-max approximation using linear programming techniques. There is 

a well-known program written by Parks and McClellan (1973) that uses the REMEZ ex- 
change algorithm to produce an optimal set of FIR filter coefficients, given the required 
frequency response of the filter. The Parks-McClellan program is available on the IEEE 
digital signal processing tape or as part of many of the filter design packages available for 
personal computers. The program is also printed in several DSP texts (see Elliot 1987 or 
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Rabiner and Gold 1975). The program REMEZ.C is a C language implementation of the 
Parks-McClellan program and is included on the enclosed disk. An example of a filter de- 
signed using the REMEZ program is shown at the end of section 4.1.2 in chapter 4. 

The design of digital filters will not be considered in detail here. Interested readers 
may wish to consult references listed at the end of this chapter giving complete descrip- 
tions of all the popular techniques. 

The frequency response of FIR filters can be investigated by using the transfer 
function developed for a general linear operator: 



H(z) = 



Q - 1 

Xv 

r(z)_. 



i + Xv p 



Notice that the sums have been made finite to make the filter realizable. Since for FIR fil- 
ters the a p are all equal to 0, the equation becomes: 

= " = < L59 > 

AU) q~0 

The Fourier transform or frequency response of the transfer function is obtained by let- 
ting z = e-> 2K f which gives 

G-l 

H(f) = H(z) I w d-60) 

<?=0 

This is a polynomial in powers of z -1 or a sum of products of the form 
H(z) = b 0 + b x z~ l +b 2 z~ 2 +b 3 z~ 3 +... + b Q _ l z HQ ~ 1) . 

There is an important class of FIR filters for which this polynomial can be factored into a 
product of sums from 

M - 1 N - 1 

W(Z>= +« m Z-‘ +P B )II < Z " 1 + ?n)- 0- 61 > 



This expression for the transfer function makes explicit the values of the variable z 1 which 
cause H(z) to become zero. These points are simply the roots of the quadratic equation 

° = z -2 +a m z -1 +(3 m , 



which in general provides complex conjugate zero pairs, and the values y n which provide 
single zeros. 
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In many communication and image processing applications it is essential to have 
filters whose transfer functions exhibit a phase characteristic that changes linearly with a 
change in frequency. This characteristic is important because it is the phase transfer rela- 
tionship that gives minimum distortion to a signal passing through the filter. A very use- 
ful feature of FIR filters is that for a simple relationship of the coefficients, b , the result- 
ing filter is guaranteed to have a linear phase response. The derivation of the relationship 
which provides a linear phase filter follows. 

A linear phase relationship to frequency means that 

where a and p are constants. If the transfer function of a filter can be separated into a real 

function of / multiplied by a phase factor W, then this transfer function will exhibit 
linear phase. 

Taking the FIR filter transfer function: 

/f(z) = i 0 +Ii 1 z _l +b 2 z~ 2 +b 3 z~ 3 + ... + b Q _ lZ ~ (Q - l) 
and replacing z by e j2K f to give the frequency response 

H(f) = b 0 + b ie - J2n/ + b > 2 e~ j2 ^ 2f) + ... + b Q _ ie - i2lliQ - {) f . 

Factoring out the factor ^« 2 -llf 2 and letting ^ equa , (Q _ 1)/2 givgs 

H(f) = e- j2 *y{b 0 e J2 *y + b x e J2K ^ + b 2 e i2 ^~ 2) f 

+... + b Q _ 2 e-™-"f + b Q _ ie -i 2 'V}. 

Combining the coefficients with complex conjugate phases and placing them together in 
Drackets 

H(f) = +b Q _ x e~W] 

+ [b x e i2n ^- l) f + b Q _ 2 e- J2 *&-'» J 
+ [b 2 e J2n &- 2) f + b Q _ 3 ^ 2 ”«- 2 )/] 

+...} 

If each pair of coefficients inside the brackets is set equal as follows: 

b 0 = *e-i 
b{ = bg_ 2 
b 2 = b Q _ 3 , etc. 

Each term m brackets becomes a cosine function and the linear phase relationship is 
achieved. This is a common characteristic of FIR filter coefficients. 
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1.3.2 Infinite Impulse Response (HR) Filters 

Repeating the general equation for HR filters 

Q - 1 p - 1 

y(n) = X b qX(n - q) a p y(n - p). 

< 7=0 p = 1 

The z-transform of the transfer function of an HR filter is 

Q - 1 

g=0 

P - 1 

l+ 'E, a P z ~ p 

p=i 

No simple relationship exists between the coefficients of the IIR filter and the im- 
pulse response sequence such as that which exists in the FIR case. Also, obtaining linear 
phase IIR filters is not a straightforward coefficient relationship as is the case for FIR fil- 
ters. However, IIR filters have an important advantage over FIR structures: In general, 
IIR filters require fewer coefficients to approximate a given filter frequency response 
than do FIR filters. This means that results can be computed faster on a general purpose 
computer or with less hardware in a special purpose design. In other words, IIR filters are 
computationally efficient. The disadvantage of the recursive realization is that IIR filters 
are much more difficult to design and implement. Stability, roundoff noise, and some- 
times phase nonlinearity must be considered carefully in all but the most trivial IIR filter 
designs. 

The direct form IIR filter realization shown in Figure 1 .9, though simple in appear- 
ance, can have severe response sensitivity problems because of coefficient quantization, 
especially as the order of the filter increases. To reduce these effects, the transfer function 
is usually decomposed into second order sections and then realized as cascade sections. 
The C language implementation given in section 4.1.3 uses single precision floating-point 
numbers in order to avoid coefficient quantization effects associated with fixed-point im- 
plementations that can cause instability and significant changes in the transfer function. 

IIR digital filters can be designed in many ways, but by far the most common IIR 
design method is the bilinear transform. This method relies on the existence of a known 
s-domain transfer function (or Laplace transform) of the filter to be designed. The 
j-domain filter coefficients are transformed into equivalent z-domain coefficients for use 
m an IIR digital filter. This might seem like a problem, since s-domain transfer functions 
are just as hard to determine as z-domain transfer functions. Fortunately, Laplace trans- 
form methods and s-domain transfer functions were developed many years ago for de- 
signing analog filters as well as for modeling mechanical and even biological systems. 
Thus, many tables of s-domain filter coefficients are available for almost any type of fil- 
ter function (see the references for a few examples). Also, computer programs are avail- 
able to generate coefficients for many of the common filter types (see the books by Jong. 
Anoutino, Steams (1993), Embree (1991), or one of the many filter design packages 
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available for personal computers). Because of the vast array of available filter tables, the 
large number of filter types, and because the design and selection of a filter requires care- 
ful examination of all the requirements (passband ripple, stopband attenuation as well as 
phase response in some cases), the subject of s-domain IIR filter design will not be cov- 
ered in this book. However, several IIR filter designs with exact z-domain coefficients 
are given in the examples in section 4.1 and on the enclosed disk. 

1.3.3 Examples of Filter Responses 

As an example of the frequency response of an FIR filter with very simple coefficients, 
take the following moving average difference equation: 

y(n) = 0. 1 1 x(n) + 0.22 x(n - 1) + 0.34 x(n - 2) 

+ 0.22 x(n - 3) + 0. 1 1 x(n - 4). 

One would suspect that this filter would be a lowpass type by inspection of the coefficients, 
since a constant (DC) value at the input will produce that same value at the output. Also, 
since all coefficients are positive, it will tend to average adjacent values of the signal. 




The response of this FIR filter is shown in Figure 1 . 13. It is indeed lowpass and the 
nulls in the stop band are characteristic of discrete time filters in general. 

As an example of the simplest IIR filter, take the following difference equation: 

y(n) = x(n) + y(n - 1). 

Some contemplation of this filter’s response to some simple inputs (like constant values, 
0, 1 , and so on) will lead to the conclusion that it is an integrator. For zero input, the out- 
put holds at a constant value forever. For any constant positive input greater than zero, 
the output grows linearly with time. For any constant negative input, the output decreases 
linearly with time. The frequency response of this filter is shown in Figure 1.14. 

1.3.4 Filter Specifications 

As mentioned previously, filters are generally specified by their performance in the fre- 
quency domain, both amplitude and phase response as a function of frequency. Fig- 
ure 1.15 shows a lowpass filter magnitude response characteristic. The filter gain has 




FIGURE 1.13 FIR low pass response. 



FIGURE 1.14 IIR integrator response. 





Magnitude 
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been normalized to be roughly 1.0 at low frequencies and the sampling rate is normalized 
to unity. The figure illustrates the most important terms associated with filter specifica- 
tions. 

The region where the filter allows the input signal to pass to the output with little or 
no attenuation is called the passband. In a lowpass filter, the passband extends from fre- 
quency /= 0 to the start of the transition band, marked as frequency f in Figure 1.15. 
The transition band is that region where the filter smoothly changes from passing the sig- 
nal to stopping the signal. The end of the transition band occurs at the stopband fre- 
quency,/^. The stopband is the range of frequencies over which the filter is specified to 
attenuate the signal by a given factor. Typically, a filter will be specified by the following 
parameters: 

(1) Passband ripple — 25 in the figure. 

(2) Stopband attenuation — 1/A. 

(3) Transition start and stop frequencies — f pass and f s[op . 

(4) Cutoff frequency — f pass . The frequency at which the filter gain is some given fac- 
tor lower than the nominal passband gain. This may be -1 dB, -3 dB or other gain 
value close to the passband gain. 

Computer programs that calculate filter coefficients from frequency domain magni- 
tude response parameters use the above list or some variation as the program input. 




Frequency 



FIGURE 1.15 Magnitude response of normalized lowpass filter. 



Sec. 1.4 Discrete Fourier Transforms 



25 



1.4 DISCRETE FOURIER TRANSFORMS 

So far, the Fourier transform has been used several times to develop the characteristics of 
sequences and linear operators. The Fourier transform of a causal sequence is: 

f{x(n)) = X(f) = Y j x(n)e^ 2nln 

n = 0 

where the sample time period has been normalized to 1 (7’= 1) 
ited duration (as must be true to be of use in a computer) then 

X(f) = y £ x( n)e~^ (1.63) 

n = 0 

where the sampled time domain waveform is N samples long. The inverse Fourier trans- 
form is 

Wf ) } = x(n) = f^X(f)e^ n df (1.64) 

since X(f) is periodic with period 1/7=1, the integral can be taken over any full period 
Therefore, 

x(n) = Jo X( f^ e ~ i2md f- (1.65) 

1.4.1 Form 

These representations for the Fourier transform are accurate but they have a major drawback 
for digital applications— the frequency variable is continuous, not discrete. To overcome this 
problem, both the time and frequency representations of the signal must be approximated. 

To create a discrete Fourier transform (DFT) a sampled version of the frequency 
waveform is used. This sampling in the frequency domain is equivalent to convolution in 
the time domain with the following time waveform: 

h (0= j^5(f-rr). 

r=— oo 

This creates duplicates of the sampled time domain waveform that repeats with period T. 
This 7 is equal to the 7 used above in the time domain sequence. Next, by using the same 
number of samples in one period of the repeating frequency domain waveform as in one pe- 
riod of the time domain waveform, a DFT pair is obtained that is a good approximation to 
the continuous variable Fourier transform pair. The forward discrete Fourier transform is 

N - 1 

X(k) = ^x(n)e-^ /N ( 1 . 66 ) 

n = 0 



(1.62) 

. If the sequence is of lim- 
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and the inverse discrete Fourier transform is 




-j2itknl N 



(1.67) 



For a complete development of the DFT by both graphical and theoretical means, see the 
text by Brigham (chapter 6). 



This corresponds to Property 8-5 in Brigham. Remember that for the DFT it is assumed 
that the sequence x(m) goes on forever repeating its values based on the period n = 0 to 
N - 1 . So the meaning of the negative time arguments is simply that 

x{~p) = x(N - p), for p = 0 to N - 1 . 

1.4.3 Power Spectrum 



1.4.2 Properties 

This section describes some of the properties of the DFT. The corresponding paragraph 
numbers in the book The Fast Fourier Transform by Brigham (1974) are indicated. Due to 
the sampling theorem it is clear that no frequency higher than V 2T can be represented by 
X(k). However, the values of k extend to AM, which corresponds to a frequency nearly 
equal to the sampling frequency V r . This means that for a real sequence, the values of k 
from NI2 to AM are aliased and, in fact, the amplitudes of these values of X(k) are 

| X(k) | = | X(N — k) |, for k = N/2 to A! - 1 . (1.68) 

This corresponds to Properties 8-1 1 and 8-14 in Brigham. 

The DFT is a linear transform as is the z-transform so that the following relation- 
ships hold: 

If 



x(n) = aa(n)+$b(n), 

where a and P are constants, then 

X(k) = aA(k) + pB(k), 

where A(ifc) and B(k) are the DFTs of the time functions a(n) and h(n), respectively. This 
corresponds to Property 8-1 in Brigham. 

The DFT also displays a similar attribute under time shifting as the z-transform. If 
X(k) is the DFT of x(n) then 

DFT{r(n - p) 1 = £ x(n - p)e~ i2knlN 

n = 0 

Now define a new variable m = r - p so that n = m + p. This gives 

m- N- l-p 

DFT{x(n - p) } = £ x(m)e- inkm/N e- J2nkplN , 

m~-p 

which is equivalent to the following: 

DFT{x(n-p)} = e~ J2nkplN X(k). (1.69) 



The DFT is often used as an analysis tool for determining the spectra of input sequences. 
Most often the amplitude of a particular frequency component in the input signal is de- 
sired. The DFT can be broken into amplitude and phase components as follows: 

*(/) = Xre.l(/) + 7X,m ag (/) (1-70) 

X(f) = \X(f)\e m) (1.71) 

where | X(/)| = -Jx 2 ^ +~X 2 r ^ g 

and 0(/) = tan' 1 . 

_ -^real _ 

The power spectrum of the signal can be determined using the signal spectrum times its 
conjugate as follows: 

X<.k)X*(k) = | X(ktf= XL + X, 2 lmlg . (1.72) 

There are some problems with using the DFT as a spectrum analysis tool, however. The 
problem of interest here concerns the assumption made in deriving the DFT that the se- 
quence was a single period of a periodically repeating waveform. For almost all se- 
quences there will be a discontinuity in the time waveform at the boundaries between 
these pseudo periods. This discontinuity will result in very high-frequency components in 
the resulting waveform. Since these components can be much higher than the sampling 
theorem limit of l / 2r (or half the sampling frequency) they may be aliased into the middle 
of the spectrum developed by the DFT. 

The technique used to overcome this difficulty is called windowing. The problem to 
be overcome is the possible discontinuity at the edges of each period of the waveform. 
Since for a general purpose DFT algorithm there is no way to know the degree of discon- 
tinuity at the boundaries, the windowing technique simply reduces the sequence ampli- 
tude at the boundaries. It does this in a gradual and smooth manner so that no new dis- 
continuities are produced, and the result is a substantial reduction in the aliased frequency 
components. This improvement does not come without a cost. Because the window is 
modifying the sequence before a DFT is performed, some reduction in the fidelity of the 
spectral representation must be expected. The result is somewhat reduced resolution of 
closely spaced frequency components. The best windows achieve the maximum reduc- 
tion of spurious (or aliased) signals with the minimum degradation of spectral resolution. 

There are a variety of windows, but they all work essentially the same way: 



" y 

-1 -^mag 

_ Threat 
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Attenuate the sequence elements near the boundaries (near n = 0 and n = N - 1) and com- 
pensate by increasing the values that are far away from the boundaries. Each window has 
its own individual transition from the center region to the outer elements. For a compari- 
son of window performance see the references listed at the end of this chapter. (For ex- 
ample, see Harris (1983)). 

1.4.4 Averaged Periodograms 

Because signals are always associated with noise — either due to some physical attribute of 
the signal generator or external noise picked up by the signal source — the DFT of a single 
sequence from a continuous time process is often not a good indication of the true spec- 
trum of the signal. The solution to this dilemma is to take multiple DFTs from successive 
sequences from the same signal source and take the time average of the power spectrum. 
If a new DFT is taken each NT seconds and successive DFTs are labeled with superscripts: 

M-l 

Power Spectrum = £[4 al ) 2 + (*‘ mag ) 2 ]. (1.73) 

i=0 

Clearly, the spectrum of the signal cannot be allowed to change significantly during the 
interval t = 0 to t = M (NT). 

1.4.5 The Fast Fourier Transform (FFT) 

The fast Fourier transform (or FFT) is a very efficient algorithm for computing the DFT 
of a sequence. It takes advantage of the fact that many computations are repeated in the 
DFT due to the periodic nature of the discrete Fourier kernel: e~J 2nkn ' N . The form of the 
DFT is 

AT- 1 

X(k)^x(n)e- J2nMN . (1.74) 

n = 0 

By letting W nk = e ~J 2nkn 1 N Equation (1.74) becomes 



N - 1 

X(fc) = ^x(n)W n *. (1.75) 

n=0 

Now, \M N + 9NK k + rN) _ W nk f or a n q r t h at are integers due to the periodicity of the 
Fourier kernel. 

Next break the DFT into two parts as follows: 

At/2— 1 Nl 2-1 

X(k)= ^x(2n)W^ nk + ^x(2n + l)Wj? n+m , (1.76) 

«= 0 71=0 

where the subscript N on the Fourier kernel represents the size of the sequence. 
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By representing the even elements of the sequence x(n) by jr and the odd elements 
by x (xj , the equation can be rewritten 

M 2-1 2V/2— 1 

X(k) = X *„<«)< + W Nn (1.77) 

<1=0 n=0 

Now there are two expressions in the form of DFTs so Equation (1.77) can be simplified 
as follows: 

x (k) = X ev (ri)+Wk rl X od (n). (1.78) 

Notice that only DFTs of N/2 points need be calculated to find the value of X(k). Since 
the index k must go to TV - 1, however, the periodic property of the even and odd DFTs is 
used. In other words, 

X ev (k) = X n (k- y) for y <k<N-l. (1.79) 

The process of dividing the resulting DFTs into even and odd halves can be repeated until 
one is left with only two point DFTs to evaluate 

A(k) = m + MDe- J2nk/2 for all k 
= A.(0) + A.(1) for* even 

= A.(0) - A.(l) for k odd. 

Therefore, for 2 point DFTs no multiplication is required, only additions and subtrac- 
hons. To compute the complete DFT still requires multiplication of the individual 2-point 
DFTs by appropriate factors of W ranging from to Figure 1.16 shows a flow 

graph of a complete 32-point FFT. The savings in computation due to the FFT algorithm 
is as follows. 

For the original DFT, N complex multiplications are required for each of N values 
of k. Also, N - 1 additions are required for each k. 

In an FFT each function of the form 

A,(0)±IT P A.(1) 

(called a butterfly due to its flow graph shape) requires one multiplication and two addi- 
tions. From the flow graph in Figure 1.16 the number of butterflies is 



Number of butterflies = -jIog 2 (A/). 



This is because there are N/2 rows of butterflies (since each butterfly has two inputs) and 
there are log 2 (N) columns of butterflies. 

Table 1 . 1 gives a listing of additions and multiplications for various sizes of FFTs 
and DFTs. The dramatic savings in time for larger DFTs provided in the FFT has made 
this method of spectral analysis practical in many cases where a straight DFT computa- 
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tion would be much too time consuming. Also, the FFT can be used for performing oper- 
ations in the frequency domain that would require much more time consuming computa- 
tions in the time domain. 



1 .4.6 An Example of the FFT 

In order to help the reader gain more understanding of spectrum analysis with the FFT, a 
simple example is presented here. An input signal to a 16-point FFT processor is as fol- 
lows: 

x(n) = cos[2jc (4n/16)]. 

The argument of the cosine has been written in an unusual way to emphasize the fre- 
quency of the waveform when processed by a 16-point FFT. The amplitude of this signal 
is 1.0 and it is clearly a real signal, the imaginary component having zero amplitude. 
Figure 1.17 shows the 16 samples that comprise x(0) to x(15). 
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TABLE 1.1 Comparison of Number of Butterfly Operations in the DFT and FFT, 
(each operation is one complex multiply/accumulate calculation). 



Transform Length 

(AO 


DFT Operations 

((V 2 ) 


FFT Operations 
NLOG 2 (N) 


8 


64 


24 


16 


256 


64 


32 


1024 


160 


64 


4096 


384 


128 


16384 


8% 


256 


65536 


1024 


512 


262144 


4608 


1024 


1048576 


10240 


2048 


4194304 


22528 



With this input a 16-point FFT will produce a very simple output. This output is 
shown in Figure 1.18. It is a spike at k = 4 of amplitude 0.5 and a spike at k = 12 of am- 
plitude -0.5. The spike nature in the FFT output in this example occurs because for a co- 
sine waveform of arbitrary frequency the Fourier transform is 

X(f) = J^cos^n if 0 t)e~ j27 #dt. 

Representing the cosine by exponentials 

X(f) = ~f°°e j2K(/ °~ /) 'dt - i J^°e^ 2mfo+/), dt. 

Cos (2x4 ^ ) 



+1 



A . A . A 






FIGURE 1.18 Output of 16-point FFT. 

It can be shown that the integrand in the two integrals above integrates to 0 unless the ar- 
gument of the exponential is 0. If the argument of the exponential is zero, the result is 
two infinite spikes, one at/=/ 0 and the other at /= ~/ 0 . These are delta functions in the 
frequency domain. 

Based on these results, and remembering that the impulse sequence is the digital 
analog of the delta function, the results for the FFT seem more plausible. It is still left to 
explain why k= 12 should be equivalent to /= -/ Q . Referring back to the development of 
the DFT, it was necessary at one point for the frequency spectrum to become periodic 
with period f s . Also, in the DFT only positive indices are used. Combining these two facts 
one can obtain the results shown in Figure 1.18. 



1.5 NONLINEAR OPERATORS 



Most of this book is devoted to linear operators and linear-signal processing because 
these are the most commonly used techniques in DSP. However, there are several nonlin- 
ear operators that are very useful in one-dimensional DSP. This section introduces the 
simple class of nonlinear operators that compress or clip the input to derive the output se- 
quence. 

There is often a need to reduce the number of significant bits in a quantized se- 
quence. This is sometimes done by truncation of the least significant bits. This process is 
advantageous because it is linear: The quantization error is increased uniformly over the 
entire range of values of the sequence. There are many applications, however, where the 
need for accuracy in quantization is considerably less at high-signal values than at low- 
signal values. This is true in telephone voice communications where the human ear’s 
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ability to differentiate between amplitudes of sound waves decreases with the amplitude 
of the sound. In these cases, a nonlinear function is applied to the signal and the resulting 
output range of values is quantized uniformly with the available bits. 

, lft , ™! pr0cess is illustrated in Figure 1.19. First, the input signal is shown in Figure 
1.19(a). The accuracy is 12 bits and the range is 0 to 4.095 volts, so each quantization 
level represents 1 mV. It is necessaiy because of some system consideration (such as 
transmission bandwidth) to reduce the number bits in each word to 8. Figure 1.19(b) 
shows that the resulting quantization levels are 16 times as coarse. Figure 1.19(c) shows 
the result of applying a linear-logarithmic compression to the input signal. In this type of 
compression the low-level signals (out to some specified value) are unchanged from the 
mput values. Beginning at a selected level, say 4 = a> a logarithmic function is applied 
The form of the function might be 

./out — Q + A log 10 (l + 4 — a) 

so that at 4 - a the output also equals a and A is chosen to place the maximum value of 
4it at the desired point. 

A simpler version of the same process is shown in Figure 1 .20. Instead of applying 
a logarithmic function from the point/= a onward, the output values for/> a are all the 
same. This is an example of clipping. A region of interest is defined and any values out- 
side the region are given a constant output. 

1.5.1 p-Law and A-Law Compression 



There are two other compression laws worth listing because of their use in telephony— 
the \x-law and A-law conversions. The p -law conversion is defined as follows: 



/out =sgn(4) 



In(l + Pl4l) 

ln(l + p) 



(1.80) 



where sgn() is a function that takes the sign of its argument, and p is the compression pa- 
rameter (255 for North American telephone transmission). The input value f must be 
normalized to lie between -1 and +1. The A-law conversion equations are as follows: 



/ou.= s gn(4)— 4' - 
1 + ln(A) 

for t/j n | between 0 and 1/A and 

1 + ln( A) 

for 14,1 between 1/A and 1. 



In these equations, A is the compression parameter (87.6 for European telephone trans- 
mission). 

An extreme version of clipping is used in some applications of image processing to 
produce binary pictures. In this technique a threshold is chosen (usually based on a his- 
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Input FIGURE 1.19 (a) Linear 12-bit ADC. 

(b) Linear 8-bit ADC. (c) Nonlinear 
conversion. 



togram of the picture elements) and any image element with a value higher than threshold 
is set to 1 and any element with a value lower than threshold is set to zero. In this way the 
significant bits are reduced to only one. Pictures properly thresholded can produce excel- 
lent outlines of the most interesting objects in the image, which simplifies further pro- 
cessing considerably. 
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Output (Integer) 




Input (V) 



FIGURE 1.20 Clipping to 8 bits. 



1.6 PROBABILITY AND RANDOM PROCESSES 

The signals of interest in most signal-processing problems are embedded in an environ- 
ment of noise and interference. The noise may be due to spurious signals picked up dur- 
ing transmission (interference), or due to the noise characteristics of the electronics that 
receives the signal or a number of other sources. To deal effectively with noise in a sig- 
nal, some model of the noise or of the signal plus noise must be used. Most often a proba- 
bilistic model is used, since the noise is, by nature, unpredictable. This section introduces 
the concepts of probability and randomness that are basic to digital signal processing and 
gives some examples of the way a composite signal of interest plus noise is modeled. 

1.6.1 Basic Probability 

Probability begins by defining the probability of an event labeled A as P(A). Event A can 
be the result of a coin toss, the outcome of a horse race, or any other result of an activity 
that is not completely predictable. There are three attributes of this probability P(A): 

(1) P(A) > = 0. This simply means that any result will either have a positive chance of 
occurrence or no chance of occurrence. 

(2) P (All possible outcomes) = 1. This indicates that some result among those possible 
is bound to occur, a probability of 1 being certainty. 

(3) For {A,}, where (A ( . n A ( ) = 0, P(uA ; ) = X, P(A t ). For a set of events, (A,), where 
the events are mutually disjoint (no two can occur as the result of a single trial of 
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the activity), the probability of any one of the events occurring is equal to the sum 
of their individual probabilities. 



With probability defined in this way, the discussion can be extended to joint and 
conditional probabilities. Joint probability is defined as the probability of occurrence of a 
specific set of two or more events as the result of a single trial of an activity. For instance, 
the probability that horse A will finish third and horse B will finish first in a particular 

horse race is a joint probability. This is written: 

P(A n B) = P(A and B) = P(AB). ( 1 .82) 

Conditional probability is defined as the probability of occurrence of an event A given 
that B has occurred. The probability assigned to event A is conditioned by some knowl- 
edge of event B. This is written 

P(.A given B) = B(A|B). (1.83) 

If this conditional probability, P(A|B), and the probability of B are both known, the proba- 
bility of both of these events occurring (joint probability) is 

P(AB) = P(A\B)P(B). (1.84) 

So the conditional probability is multiplied by the probability of the condition (event B) 
to get the joint probability. Another way to write this equation is 



B(A|B) = 



P{AB) 

P(B) 



(1.85) 



This is another way to define conditional probability once joint probability is understood. 



1 .6.2 Random Variables 

In signal processing, the probability of a signal taking on a certain value or lying in a cer- 
tain range of values is often desired. The signal in this case can be thought of as a random 
variable (an element whose set of possible values is the set of outcomes of the activity). 
For instance, for the random variable X, the following set of events, which could occur, 
may exist: 

Event A X takes on the value of 5 (X = 5) 

Event BX= 19 
Event C X = 1 .66 
etc. 



This is a useful set of events for discrete variables that can only take on certain specified 
values. A more practical set of events for continuous variables associates each event with 
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die variable lying within a range of values. A cumulative distribution function (or CDF) 
tor a random variable can be defined as follows: 

F(x)=P(X<x). (1.86) 

This cumulative distribution, function, then, is a monotonically increasing function of the 
independent variable x and is valid only for the particular random variable, X. Figure 1 .21 
shows an example of a distribution function for a random variable. If F(x) is differenti- 
ated with respect to x the probability density function (or PDF) for X is obtained, repre- 
sented as follows: v 



P(x) = 



dF{x) 

dx 



(1.87) 



Integrating p(x) gives the distribution function back again as follows: 

F(x) = jj>(\.)dk. (1.88) 

Since E(x) is always monotonically increasing, p(x) must be always positive or zero, 
igure 1.22 shows the density function for the distribution of Figure 1.21. The utility of 
ese functions can be illustrated by determining the probability that the random variable 
X lies between a and b. By using probability Property 3 from above 

P(X <b)= P(a < X <b) + P(X < a). (1.89) 

This is true because the two conditions on the right-hand side are independent (mutually 
exclusive) and X must meet one or the other if it meets the condition on the left-hand 
side. This equation can be expressed using the definition of the distribution: 

P(a < X < b) = F(b) - F(a) 

=JW. a90) 

Ja 

In * 1S ™ y ’ kn0Wlng 1116 distributi °n or the density function allows the calculation of the 
probability that X lies within any given range. 



1.6.3 Mean, Variance, and Gaussian Random Variables 

There is an operator in random variable theory called the expectation operator usually 
written E[x\. This expression is pronounced “the expected value ofx.” The expectation 
operator extracts from a random variable the value that the variable is most likely to take 
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on. The expected value is sometimes called the mean, average, or first moment of the 
variable and is calculated from the density function as follows: 

E[x] = ^ xp{x)dx. (1.91) 

A typical density function for a random variable is shown in Figure 1.23. The most likely 
value of variable x is also indicated in the figure. The expected value can be thought of as 
a “center of gravity” or first moment of the random variable x. 

The variance of a random variable is defined as 

a 2 = Var{x) = £f(x - E[x]f ], ( 1 .92) 

where o is the root mean square value of the variable’s difference from the mean. The 
variance is sometimes called the mean square value of x. 

By extending the use of the expectation operator to joint probability densities, a 
variable Y can be a function of two random variables, s and t such that 

Y = 6{s, /}. 

Then the expected value of Y will be 

£[T] = J”° j'0[,, t}p(s, t)dsdt (1.93) 

where the joint probability density of , and t (p(s,t)), is required in the equation. The cor- 
relation of two random variables is defined to be the expected value of their product 

E[,f} = J j st p(s, t)dsdt. (1-94) 



P(x) 




aw. 



FIGURE 1.23 Continuous PDF showing Elx]. 
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This definition will be used in the development of autocorrelation in section 1.6.5. 

There is a set of random variables called Gaussian random variables whose densitv 
functions have special characteristics that make them particularly easy to analyze. Also 
many physical processes give rise to approximately this sort of density function A 
Gaussian density function has the following form: 




where is the mean value of x and o' is the variance. 

1 .6.4 Quantization of Sequences 

Quantization is to the amplitude domain of a continuous analog signal as sampling is to 
the time domain. It is the step that allows a continuous amplitude signal to be represented 
in the discrete amplitude increments available in a digital computer. To analyze the 
process of quantization, it is useful to diagram a system as shown in Figure 1 24 The il 
lustration shows a continuous amplitude input signal,/, which is sampled and quantized, 
then reconstructed m the continuous amplitude domain. The output signal is/. By com- 
paring the input and output of this process the effect of quantization can be illustrated. 

The action of the box marked quantization in Figure 1.24 is illustrated in Figure 
1.25 A set of decision levels is applied to each input signal, and the two levels which 
bracket the signal above and below are determined. A digital code is assigned to the re- 
gion between each levels. In Figure 1.25, the digital code consists of 6 bits and runs from 
binary 0 to binaiy 63. The application of these decision levels and the assignment of a 
code to the input signal sample is the complete process of quantization. Reconstruction of 
the signal is accomplished by assigning a reconstruction level to each digital code. 

The task that remains is to assign actual values to the decision levels and the recon- 
struction levels. Referring to Figure 1.25, the minimum value of the input signal is la- 
beled a, and the maximum value is labeled a v . If the signal / has a probability density of 
p(J), then the mean squared error due to the quantization and reconstruction process is 




f f f 



FIGURE 1.24 Quantization and reconstruction of a signal. 
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Original Quantization Digital Quantized 

Sample Decision Code Sample 



Levels 

FIGURE 1.25 Quantization operation showing decision and reconstruction levels. 



e = £{(/ - /) 2 } = [ U (/ - ffpifW , 

and if the signal range is broken up into the segments between decision levels d and d M , 
then J 

* = £{(/ - /) 2 } = tt' if ~ r i )2 P {f)d f- 

i = o d ‘ 

Numerical solutions can be determined that minimize e for several common probability 
densities. The most common assumption is a uniform density {p{f ) equals 1/A for all val- 
ues of /, where N is the number of decision intervals). In this case, the decision levels are 
uniformly spaced throughout the interval and the reconstruction levels are centered be- 
tween decision levels. This method of quantization is almost universal in commercial 
analog-to-digital converters. For this case the error in the analog-to-digital converter out- 
put is uniformly distributed from -V 2 of the least significant bit to +'/ 2 of the least signifi- 
cant bit. If it is assumed that the value of the least significant bit is unity, then the mean 
squared error due to this uniform quantization is given by: 

var{e) = J + j(f - ff P(fW = J? f 2 df = j-, 

2 ~ 2 
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since p(f) = 1 from to +V 2 . This mean squared error gives the equivalent variance, or 
noise power, added to the original continuous analog samples as a result of the uniform 
quantization. If it is further assumed that the quantization error can be modeled as a sta- 
tionary, uncorrelated white noise process (which is a good approximation when the number 
of quantization levels is greater than 16), then a maximum signal-to-noise ratio (SNR) 
can be defined for a quantization process of B bits ( 2 s quantization levels) as follows: 

SNR = 101og 10 (V 2 / var{e)) = 101og 10 (12V 2 ), 

where V 2 is the total signal power. For example, if a sinusoid is sampled with a peak am- 
plitude of 2 s-1 , then V 2 = 2 W /S giving the signal to noise ratio for a full scale sinusoid as 

SNR = 101og 10 ((1.5)(2 2fi )) = 6.02B + 1.76. 

This value of SNR is often referred to as the theoretical signal-to-noise ratio for a B bit 
analog-to-digital converter. Because the analog circuits in a practical analog-to-digital 
converter always add some additional noise, the SNR of a real-world converter is always 
less than this value. 

1 .6.5 Random Processes, Autocorrelation, 
and Spectral Density 



A random process is a function composed of random variables. An example is the ran- 
dom process /(<)• For each value of t, the process /(f) can be considered a random vari- 
able. For t = a there is a random variable f(a) that has a probability density, an expected 
value (or mean), and a variance as defined in section 1.6.3. In a two-dimensional image, 
the function would be /( x,y), where x and y are spatial variables. A two-dimensional ran- 
dom process is usually called a random field. Each f{a,b ) is a random variable. 

One of the important aspects of a random process is the way in which the random 
variables at different points in the process are related to each other. The concept of joint 
probability is extended to distribution and density functions. A joint probability distribu- 
tion is defined as 

F(s, t ) = P(S <s,T <t) (where S and T are some constants), 
and the corresponding density function is defined as 



Pis, t) = 



d 2 F(s, t ) 
3 sdt 



The integral relationship between distribution and density in this case is 



(1.96) 



F(s , t ) = J J pip., |3)da dp. (1-97) 

In section 1 .6.3 it was shown that the correlation of two random variables is the expected 
value of their product. The autocorrelation of a random process is the expected value of 
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the products of the random variables which make up the process. The symbol for autocor- 
relation is Rff(t v f 2 ) for the function fit) and the definition is 

R ff (t l ,t 2 )=E[f(t l )f(t 2 )] C-98) 

= J ja$p f (a, P;t 1 ,r 2 )dadp, (1.99) 

where pj-( a, p; t x , t 2 ) is the joint probability density fltf) and f[t 2 ). By including a and p 
in the parentheses the dependence of p^ on these variables is made explicit. 

In the general case, the autocorrelation can have different values for each value of 
tj and t 2 . However, there is an important special class of random processes called station- 
ary processes for which the form of the autocorrelation is somewhat simpler. In station- 
ary random processes, the autocorrelation is only a function of the difference between the 
two time variables. For stationary processes 

R ff (h - f, ) = R ff &) = E\f(t - £)/(/)]. (1-100) 

In section 1 .6.6 the continuous variable theory presented here is extended to discrete vari- 
ables and the concept of modeling real world signals is introduced. 

1.6.6 Modeling Real-World Signals with AR Processes 

By its nature, a noise process cannot be specified as a function of time in the way a deter- 
ministic signal can. Usually a noise process can be described with a probability function 
and the first and second moments of the process. Although this is only a partial character- 
ization, a considerable amount of analysis can be performed using moment parameters 
alone. The first moment of a process is simply its average or mean value. In this section, 
all processes will have zero mean, simplifying the algebra and derivations but providing 
results for the most common set of processes. 

The second moment is the autocorrelation of the process 

tfn, n-k) = E{u(n)u\n - £)], for k = 0, ± 1, ± 2, . . . . 

The processes considered here are stationary to second order. This means that the first 
and second order statistics do not change with time. This allows the autocorrelation to be 
represented by 

r(n,n-k) = r(k), fork = 0, + 1, + 2,... 

since it is a function only of the time difference between samples and not the time vari- 
able itself. In any process, an important member of the set of autocorrelation values is 
r(0), which is 



r(0) = E{u{n)u*(n)} = e{|w(h)| 2 }> 



(1.101) 
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which is the mean square value of the process. For a zero mean process this is equal to 
the variance of the signal 



r(0) = var{n}. 

The process can be represented by a vector u (n) where 

u(n) 
u(n - 1) 
u(n) = u(n - 2) 



(1.102) 



(1.103) 



[w(n-M+l)J 

Then the autocorrelation can be represented in matrix form 

R = £ , ju(n)u w (n)j 



(1.104) 
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The second moment of a noise process is important because it is directly related to 
the power spectrum of the process. The relationship is 



m — i 

S(f)= ^r( k )e- j2nfk . 



(1.105) 



which is the discrete Fourier transform (DFT) of the autocorrelation of the process (r<Jfc)). 
Thus, the autocorrelation is the time domain description of the second order statistics, and 
the power spectral density, S(f), is the frequency domain representation. This power 
spectral density can be modified by discrete time filters. 

Discrete time filters may be classified as autoregressive (AR), moving average 
(MA), or a combination of the two (ARMA). Examples of these filter structures and the 
z-transforms of each of their impulse responses are shown in Figure 1.26. It is theoreti- 
cally possible to create any arbitrary output stochastic process from an input white noise 
Gaussian process using a filter of sufficiently high (possibly infinite) order. 

Referring again to the three filter structures in Figure 1.26, it is possible to create 
any arbitrary transfer function H(z) with any one of the three structures. However, the or- 
ders of the realizations will be very different for one structure as compared to another. 
For instance, an infinite order MA filter may be required to duplicate an Af h order AR 
filter. 

One of the most basic theorems of adaptive and optimal filter theory is the Wold 



J 
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decomposition. This theorem states that any real-world process can be decomposed into a 
deterministic component (such as a sum of sine waves at specified amplitudes, phases, 
and frequencies) and a noise process. In addition, the theorem states that the noise 
process can be modeled as the output of a linear filter excited at its input by a white noise 
signal. 



ADAPTIVE FILTERS AND SYSTEMS 

The problem of determining the optimum linear filter was solved by Norbert Wiener and 
others. The solution is referred to as the Wiener filter and is discussed in section 1.7.1. 
Adaptive filters and adaptive systems attempt to find an optimum set of filter parameters 
(often by approximating the Wiener optimum filter) based on the time varying input and 
output signals. In this section, adaptive filters and their application in closed loop adap- 
tive systems are discussed briefly. Closed-loop adaptive systems are distinguished from 
open-loop systems by the fact that in a closed-loop system the adaptive processor is con- 
trolled based on information obtained from the input signal and the output signal of the 
processor. Figure 1.27 illustrates a basic adaptive system consisting of a processor that is 
controlled by an adaptive algorithm, which is in turn controlled by a performance calcula- 
tion algorithm that has direct knowledge of the input and output signals. 

Closed-loop adaptive systems have the advantage that the performance calculation 
algorithm can continuously monitor the input signal ( d) and the output signal (y) and de- 
termine if the performance of the system is within acceptable limits. However, because 
several feedback loops may exist in this adaptive structure, the automatic optimization al- 
gorithm may be difficult to design, the system may become unstable or may result in 
nonunique and/or nonoptimum solutions. In other situations, the adaptation process may 
not converge and lead to a system with grossly poor performance. In spite of these possi- 
ble drawbacks, closed-loop adaptive systems are widely used in communications, digital 
storage systems, radar, sonar, and biomedical systems. 

The general adaptive system shown in Figure 1.27(a) can be applied in several 
ways. The most common application is prediction, where the desired signal {d) is the ap- 
plication provided input signal and a delayed version of the input signal is provided to the 
input of the adaptive processor ( x ) as shown in Figure 1.27(b). The adaptive processor 
must then try to predict the current input signal in order to reduce the error signal (e) to- 
ward a mean squared value of zero. Prediction is often used in signal encoding (for exam- 
ple, speech compression), because if the next values of a signal can be accurately pre- 
dicted, then these samples need not be transmitted or stored. Prediction can also be used 
to reduce noise or interference and therefore enhance the signal quality if the adaptive 
processor is designed to only predict the signal and ignore random noise elements or 
known interference patterns. 

As shown in Figure 1.27(c), another application of adaptive systems is system 
modeling of an unknown or difficult to characterize system. The desired signal ( d) is the 
unknown system’s output and the input to the unknown system and the adaptive proces- 
sor (x) is a broadband test signal (perhaps white Gaussian noise). After adaptation, the 
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unknown system is modeled by the final transfer function of the adaptive processor. By 
using an AR, MA, or ARMA adaptive processor, different system models can be ob- 
tained. The magnitude of the error (e) can be used to judge the relative success of each 
model. 

1.7.1 Wiener Filter Theory 

The problem of determining the optimum linear filter given the structure shown in Figure 
1.28 was solved by Norbert Wiener and others. The solution is referred to as the Wiener 
filter. The statement of the problem is as follows: 

Determine a set of coefficients, w^, that minimize the mean of the squared error of 
the filtered output as compared to some desired output. The error is written 



M 

e{n) = d(n) - w' k u(n - k + 1), 



(1.106) 



or in vector form 



e(n) = d{n) - vr H u(n). (1.107) 

The mean squared error is a function of the tap weight vector w chosen and is written 



7(w) = E{e(n)e\n)}. 



(1.108) 
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FIGURE 1.28 Wiener filter problem. 
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Substituting in the expression for e(n) gives 

J( w) = E^d(n)d*{n) - d(/i)u w (n)w 

-w w u(n)d*(n)+ w w u(n)u w (n)w] 
7(w) = var{d)-p w w- w tf p + w w Rw, 



(1.109) 

( 1 . 110 ) 



where p = E{u(n)d*(n)}, the vector that is the product of the cross correlation between 
the desired signal and each element of the input vector. 

In order to minimize J( w) with respect to w, the tap weight vector, one must set the de- 
rivative of 7(w) with respect to w equal to zero. This will give an equation which, when 
solved for w, gives w (> the optimum value of w. Setting the total derivative equal to zero gives 

-2p + 2Rw 0 = 0 (1.111) 

or 

Rw o=P (1.112) 

If the matrix R is invertible (nonsingular) then w () can be solved as 

w 0 — R -1 p. (1.113) 

So the optimum tap weight vector depends on the autocorrelation of the input 
process and the cross correlation between the input process and the desired output. 
Equation (1.1 13) is called the normal equation because a filter derived from this equation 
will produce an error that is orthogonal (or normal) to each element of the input vector. 
This can be written 

E{n(,n)e 0 *{n)} = 0 . (1.114) 

It is helpful at this point to consider what must be known to solve the Wiener filter 
problem: 



(1) The MxM autocorrelation matrix of u(n), the input vector 

(2) The cross correlation vector between u(n) and d(n) the desired response. 



It is clear that knowledge of any individual u(n) will not be sufficient to calculate 
these statistics. One must take the ensemble average, E{ }, to form both the autocorrela- 
tion and the cross correlation. In practice, a model is developed for the input process and 
from this model the second order statistics are derived. 

A legitimate question at this point is: What is din)! It depends on the problem. One ex- 
ample of the use of Wiener filter theoiy is in linear predictive filtering. In this case, the de- 
sired signal is the next value of u(n), the input. The actual u In) is always available one sam- 
ple after the prediction is made and this gives the ideal check on the quality of the prediction. 
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CHAPTER 



C Programming 
Fundamentals 



The purpose of this chapter is to provide the programmer with a complete overview of 
the fundamentals of the C programming language that are important in DSP applications. 
In particular, text manipulation, bitfields, enumerated data types, and unions are not dis- 
cussed, because they have limited utility in the majority of DSP programs. Readers with 
C programming experience may wish to skip the bulk of this chapter with the possible 
exception of the more advanced concepts related to pointers and structures presented in 
sections 2.7 and 2.8. The proper use of pointers and data structures in C can make a DSP 
program easier to write and much easier for others to understand. Example DSP programs 
in this chapter and those which follow will clarify the importance of pointers and data 
structures in DSP programs. 

.1 THE ELEMENTS OF REAL-TIME DSP PROGRAMMING 

The purpose of a programming language is to provide a tool so that a programmer can 
easily solve a problem involving the manipulation of some type of information. Based on 
this definition, the purpose of a DSP program is to manipulate a signal (a special kind of 
information) in such a way that the program solves a signal-processing problem. To do 
this, a DSP programming language must have five basic elements: 

(1) A method of organizing different types of data (variables and data types) 

(2) A method of describing the operations to be done (operators) 

(3) A method of controlling the operations performed based on the results of operations 
(program control) 
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1.7.2 LMS Algorithms 



The LMS algorithm is the simplest and most used adaptive algorithm in use today. In this 
bnef section, the LMS algorithm as it is applied to the adaptation of time-varying FIR fii 
ters (M A systems) and HR filters (adaptive recursive filters or ARMA systems) is de 
“^<2 ° n ' j " Slificaao " “™«-» properties cm be found i„ 

For the adaptive FIR system the transfer function is described by 



Q - 1 

y(n) = ^b q (k)x(n-q). 



(1.115) 



where b(k) indicates the time-varying coefficients of the filter. With an FIR filter the 
mean squared error performance surface in the multidimensional space of the filter coef 
icients is a quadratic function and has a single minimum mean squared error (MMSE) 
The coefficient values at the optimal solution is called the MMSE solution The goal of 
he adaptive process is to adjust the filter coefficients in such a way that they move from 
die, r current position toward the MMSE solution. If the input signal changes with tin,™ 
he adaptive system must continually adjust the coefficients to follow the MMSE solu’ 
tion. In practice, the MMSE solution is often never reached 

The LMS algorithm updates the filter coefficients based on the method of steepest 
descent. This can be described in vector notation as follows: ^ 






(1.116) 



™ B * COeff ? Cient C °' Umn VeCt0r ’ P is a Pieter that controls the rate of con- 
vergence and the gradient is approximated as 



_ 3£ H] 



= -2 e*X* 



(H17) 



72^t^ U ;r" COl r VeCt0r and E * iS the err ° r signal as sho *n ™ Figure 
v.lf. I nus, the basic LMS algorithm can be written as 



= B t +2p e ,X* 



(1.118) 



The selection of the convergence parameter must be done carefully because if it is 

the signal 1 ari 1 convergence Parameter is too large, the system will adapt to noise in 

tne signal and may never converge to the MMSE solution. 

For the adaptive IIR system the transfer function is described by 



/>-i 

y(„) = (k)x(n - q) a p ( k)y{n - p). 
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where b(k) and a(k) indicate the time- varying coefficients of the filter. With an IIR filter 
the mean squared error performance surface in the multidimensional space of the filter 

Z lTT T° ta u qUadrallc funCtion and can have multiple minimums that may cause 
the adaptive algorithm to never reach the MMSE solution. Because the IIR system has 

poles the system can become unstable if the poles ever move outside the unit circle dur- 
ing the adaptive process. These two potential problems are serious disadvantages of adap- 

rj CUrS,Ve , fi * erS , that Ilm,t the,r a PPl'cation and complexity. For this reason, most ap- 
plications are limited to a small number of poles. The LMS algorithm can again be used 
to update the filter coefficients based on the method of steepest descent. This can be de 
scribed m vector notation as follows: 

W w =W,-MV ( , (1.120) 

where W* is the coefficient column vector containing the a and b coefficients, M is a di- 
agonal matrix containing convergence parameters p for the a coefficients and v n through 
p ~ l that controls the rate of convergence of the b coefficients. In this case, the gradient 
is approximated as 611 

=- 2 *k[a-o .-«£?-ilV-P/.] r , (1.121) 

where e k is the error signal as shown in Figure 1.27, and 

e-i 

a n( k ) = x{k-n) + ^b q (k)a n {k~q) ( 1 . 1 22) 

«= o 

P-1 

P n( k ) = y(k-n) + ^b q (k) P„ (k - p). ( 1 . 1 23) 

P = 0 

The selection of the convergence parameters must be done carefully because if they 
are too small the coefficient vector will adapt very slowly and may not react to changes in 
input signal. If the convergence parameters are too large the system will adapt to 

ZuH in , K S ' gn beC ° me Unstable - The P r °P° sed " ew location of the poles 

1 , £ Tlf e3Ch Upd3te *° delermi ne if an unstable adaptive filter is 

. ' be t USed ' If “ unst able pole location is found the update should not take place 
and the next update value may lead to a better solution. F 
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(4) A method of organizing the data and the operations so that a sequence of program 
steps can be executed from anywhere in the program (functions and data structures) 
and 

(5) A method to move data back and forth between the outside world and the program 
(input/output) 

These five elements are required for efficient programming of DSP algorithms. Their im- 
plementation in C is described in the remainder of this chapter. 

As a preview of the C programming language, a simple real-time DSP program is 
shown in Listing 2.1. It illustrates each of the five elements of DSP programming. The 
listing is divided into six sections as indicated by the comments in the program. This sim- 
ple DSP program gets a series of numbers from an input source such as an A/D converter 
(the function get input ( ) is not shown, since it would be hardware specific) and deter- 
mines the average and variance of the numbers which were sampled. In signal-processing 
terms, the output of the program is the DC level and total AC power of the signal. 

The first line of Listing 2.1, main( ), declares that the program called main, which 
has no arguments, will be defined after the next left brace ({ on the next line). The main 
program (called main because it is executed first and is responsible for the main control 
of the program) is declared in the same way as the functions. Between the left brace on 
the second line and the right brace half way down the page (before the line that starts 
float average . . .) are the statements that form the main program. As shown in this 
example, all statements in C end in a semicolon (;) and may be placed anywhere on the 
input line. In fact, all spaces and carriage control characters are ignored by most C com- 
pilers. Listing 2.1 is shown in a format intended to make it easier to follow and modify. 

The third and fourth lines of Listing 2.1 are statements declaring the functions 
(average, variance, sqrt) that will be used in the rest of the main program (the 
function scjrt ( ) is defined in the standard C library as discussed in the Appendix. This 
first section of Listing 2.1 relates to program organization (element four of the above 
list). The beginning of each section of the program is indicated by comments in the pro- 
gram source code (i. e., /* section 1 */). Most C compilers allow any sequence of 
characters (including multiple lines and, in some cases, nested comments) between the 
/ * and * / delimiters. 

Section two of the program declares the variables to be used. Some variables are 
declared as single floating-point numbers (such as ave and var); some variables are de- 
clared as single integers (such as i, count, and number); and some variables are ar- 
rays (such as signal [100] ). This program section relates to element one, data organi- 
zation. 

Section three reads 100 floating-point values into an array called signal using a for 
loop (similar to a DO loop in FORTRAN). This loop is inside an infinite while loop 
that is common in real-time programs. For every 100 samples, the program will display 
the results and then get another 100 samples. Thus, the results are displayed in real-time. 
This section relates to element five (input/output) and element three (program control). 
Section four of the example program uses the functions average and variance 
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main() /* section 1 */ 

{ 

float average (), variance (), sqrt () ; /* declare functions */ 

float signal [100] , ave, var; /*section 2 */ 

int count, i; /* declare variables */ 

while (1) { 

forfcount = 0 ; count < 100 ; count++) { /* section 3 */ 
signal [count] = getinputO; /* read input signal */ 

1 

ave = average (signal , count) ,- /* section 4 */ 

var = variance (signal , count ) ; /* calculate results */ 

printf ( ” \n\nAverage = %f",ave); /* section 5 */ 

printf(" Variance = %f” ,var) ; /* print results */ 

} 

} 

float average ( float array [], int size) /* section 6 */ 

{ /* function calculates average */ 

int i; 

float sum = 0.0; /* intialize and declare sum */ 

for(i = 0 ; i < size ; i++) 

sum = sum + array [i]; /* calculate sum */ 

retum(sum/size) ; /* return average */ 

} 

float variance (float array[],int size) /* function calculates variance */ 
{ 

int i; /* declare local variables */ 

float ave; 

float sum =0.0; /* intialize sum of signal */ 

float sum2 =0.0; /* sum of signal squared */ 

for(i = 0 ; i < size ; i++) { 
sum = sum + array[i] ; 

sum2 = sum2 + array [ i ] ‘array [ i ] ; /* calculate both sums */ 

) 

ave = sum/size; /* calculate average */ 

return ( ( sum2 - sum*ave) / (size-1) ) ; /* return variance */ 

} 

Listing 2.1 Example C program that calculates the average and variance of 
a sequence of numbers. 

to calculate the statistics to be printed. The variables ave and var are used to store the 
results and the library function printf is used to display the results. This part of the 
program relates to element four (functions and data structures) because the operations de- 
fined in functions average and variance are executed and stored. 
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Section five uses the library function print f to display the results a w ,, 
and also calls the function sqrt in order to display the standard deviation This 
of the program relates to element four (functions) and element five (input/output) tl 
cau^the operates defined in function sgrt are executed and the resuhs are £^1 

[,ist,nJ? e | tW £T? nS ’ avera9e and variance ’ are defined in the remaining part of 
sting 2.1. This last section relates primarily to element two (operators) since the 

defined^' T f ^ . fUnCti ° n is deflned in the »e way that the main program w * 
defined. The function and argument types are defined and the local variables to £ used T 

each functton are declared. The operations required by each function are then defined fol" 
lowed by a return statement that passes the result back to the main program. 



2.2 VARIABLES AND DATA TYPES 

All programs work by manipulating some kind of information. A variable in C is defined 
by declaring that a sequence of characters (the variable identifier or name) i e t ‘ £ 
treated as a particular predefined type of data. An identifier may be any sequence of char 
acters (usually with some length restrictions) that obeys the following three rules: 

(1) All identifiers start with a letter or an underscore (_). 

(2) The rest of the identifier can consist of letters, underscores, and/or digits. 

(3) The rest of the identifier does not match any of the C keywords. (Check compiler 

implementation for a list of these.) necx compiler 



“ nsl,ive; , “ iabte ■ «*«*« - 

01 , Th f. C langUage su PP° rts several Afferent data types that represent integers 
£e£hlr) » A flo at ' ns - poin n numbers (declared float or double), and text data fde- 

clared Th r ^ yS ° f ^ Vanab ' e type and P° inters of each type may be de- 
ared. The first two types of numbers will be covered first followed by a brief introduc- 

on o arrays (covered m more detail with pointers in section 2.7). The special treatment 
f text using character arrays and strings will be discussed in Section 2.2.3. 



2.2.1 Types of Numbers 



A C program must declare the variable before it is used in the program There are several 1 
types of numbers used depending on the format in which the numbers are stored (float I 
mg-pomt format or integer format) and the accuracy of the numbers (single-precision ver- i 

7116 foiiowing exampie iiius - 
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main( ) 



int i; 


/* 


short j; 


/* 


long k; 


/* 


float a; 


/* 


double b; 


/* 


k = 72000; 




j = k; 




i = k; 




b = 0.1; 





a = b; 



size dependent on implementation */ 
16 bit integer */ 

32 bit integer */ 

single precision floating-point */ 
double precision floating-point */ 



printf ("\n%ld %d %d\n%20 . 15f \n%20 . 15f ■ ,k, j , i,b a) • 

} 




Three types of integer numbers (int, short int, and long int) and two types of 
floating-point numbers (float and double) are illustrated in this example. The actual 
sizes (in terms of the number of bytes used to store the variable) of these five types de- 
pends upon the implementation; all that is guaranteed is that a short int variable will 
not be larger than a long int and a double will be twice as large as a float. The 
size of a variable declared as just int depends on the compiler implementation. It is nor- 
mally the size most conveniently manipulated by the target computer, thereby making 
programs using ints the most efficient on a particular machine. However, if the size of 
the integer representation is important in a program (as it often is) then declaring vari- 
ables as int could make the program behave differently on different machines. For ex- 
ample, on a 16-bit machine, the above program would produce the following results: 

72000 6464 6464 

0.100000000000000 

0.100000001490116 

But on a 32-bit machine (using 32-bit ints), the output would be as follows: 

72000 6464 72000 

0.100000000000000 

0.100000001490116 

Note that in both cases the short and long variables, k and j, (the first two numbers dis- 
played) are the same, while the third number, indicating the int i. differs. In both cases, 
the value 6464 is obtained by masking the lower 16 bits of the 32-bit k value. Also, in both 
cases, the floating-point representation of 0.1 with 32 bits (float) is accurate to eight dec- 
imal places (seven places is typical). With 64 bits it is accurate to at least 15 places. 

Thus, to make a program truly portable, the program should contain only short 
int and long int declarations (these may be abbreviated short and long). In addi- 
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tion to the five types illustrated above, the three ints can be declared as unsigned by 
preceding the declaration with unsigned. Also, as will be discussed in more detail in the 
next section concerning text data, a variable may be declared to be only one byte long by 
declaring it a char (signed or unsigned). The following table gives the typical sizes 
and ranges of the different variable types for a 32-bit machine (such as a VAX) and a 16- 
bit machine (such as the IBM PC). 

16 -bit 
Machine 
Size (bits) 



8 

16 

16 

16 



2.2.2 Arrays 

Almost all high-level languages allow the definition of indexed lists of a given data type, 
commonly referred to as arrays. In C, all data types can be declared as an array simply by 
placing the number of elements to be assigned to the array in brackets after the array 
name. Multidimensional arrays can be defined simply by appending more brackets con- 
taining the array size in each dimension. Any N-dimensional array is defined as follows: 

type namelsizel] [size2] ... [sizeN] ; 

For example, each of the following statements are valid array definitions: 

unsigned int list[10); 
double input [5]; 
short int x[2000] ; 
char input_buffer [20] ; 
unsigned char image[256] [256] ; 
int matrix[4] [3] [2] 



J 




Variable 

Declaration 

char 

unsigned char 
int 

unsigned int 
short 



16 -bit 

Machine 

Range 
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Note that the array definition unsigned char image [256] [256] could define an 
8-bit, 256 by 256 image plane where a grey scale image is represented by values from 0 
to 255. The last definition defines a three-dimensional matrix in a similar fashion. One 
difference between C and other languages is that arrays are referenced using brackets to 
enclose each index. Thus, the image array, as defined above, would be referenced as 
image [i] [j] where i and j are row and column indices, respectively. Also, the first 
element in all array indices is zero and the last element is N-l, where N is the size of the 
array in a particular dimension. Thus, an assignment of the first element of the five ele- 
ment, one-dimensional array input (as defined above) such as input [0] =1.3; is 
legal while input [5]=1.3; is not. 

Arrays may be initialized when they are declared. The values to initialize the array are 
enclosed in one or more sets of braces ( { > ) and the values are separated by commas. For 
example, a one-dimensional array called vector can be declared and initialized as follows: 

int vector [6] = { 1, 2, 3, 5, 8, 13 },- 

A two-dimensional array of six double-precision floating-point numbers can be declared 
and initialized using the following statement: 

double a[3] [2] = { 

{ 1.5, 2.5 }, 

{ l.le-5 , 1 . 7e5 }, 

{ 1.765 , 12.678 } 

); 

Note that commas separate the three sets of inner braces that designate each of the three rows 
of the matrix a, and that each array initialization is a statement that must end in a semicolon. 

2.3 OPERATORS 

Once variables are defined to be a given size and type, some sort of manipulation must be 
performed using the variables. This is done by using operators. The C language has more 
operators than most languages; in addition to the usual assignment and arithmetic opera- 
tors, C also has bitwise operators and a full set of logical operators. Some of these opera- 
tors (such as bitwise operators) are especially important in order to write DSP programs 
that utilize the target processor efficiently. 

2.3.1 Assignment Operators 

The most basic operator is the assignment operator which, in C, is the single equal sign 
(=)• The value on the right of the equal sign is assigned to the variable on the left. 
Assignment statements can also be stacked, as in the statement a=b=l; . In this case, the 
statement is evaluated right to left so that 1 is assigned to b and b is assigned to a. In C, 
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a=ave(x) is an expression, while a=ave(x); is a statement. The addition of the 
semicolon tells the compiler that this is all that will be done with the result from the func 
tion ave (x) . An expression always has a value that can be used in other expressions 
Thus, a=b+ (c=ave (x) ) ; is a legal statement. The result of this statement would be 1 

that the result returned by ave (x) is assigned to c and b+c is assigned to a. C also al- 
lows multiple expressions to be placed within one statement by separating them with the ‘ 

commas. Each expression is evaluated left to right, and the entire expression (comprised I 

of more than one expression) assumes the value of the last expression which is evaluated : 

For example, a= (olda=a,ave (x) ) ; assigns the current value of a to olda, calls the j 

function ave (x) and then assigns the value returned by ave (x) to a. 

) 

2.3.2 Arithmetic and Bitwise Operators 

The usual set of binaty arithmetic operators (operators which perform arithmetic on two 1 
operands) are supported in C using the following symbols: f 

* multiplication 

/ division d 

+ addition ] 

subtraction :] 

% modulus (integer remainder after division) | 

The first four operators listed are defined for all types of variables (char, int, float 

and double). The modulus operator is only defined for integer operands. Also, there is 
no exponent operator in C; this floating-point operation is supported using a simple func- 
tion call (see the Appendix for a description of the paw function). 

In C, there are three unary arithmetic operators which require only one operand 
First is the unary minus operator (for example, -i, where i is an int) that performs a I 

two’ s-complement change of sign of the integer operand. The unary minus is often useful I 

when the exact hardware implementation of a digital-signal processing algorithm must be 5 

simulated. The other two unary arithmetic operators are increment and decrement repre- I 

sented by the symbols ++ and — , respectively. These operators add or subtract one from 1 

any integer variable or pointer. The operand is often used in the middle of an expression, 
and the increment or decrement can be done before or after the variable is used in the ex- < 

pression (depending on whether the operator is before or after the variable). Although the : 

use of ++ and - - is often associated with pointers (see section 2.7), the following exam- 
ple illustrates these two powerful operators with the ints i, j, and k: 

i = 4; I 

j = 7; 

k = i++ + j; /* i is incremented to 5, k = 11 */ 1 

k = k + /* j is decremented to 6, k = 17 */ 

k = k + i++; /* i is incremented to 6, k = 22 */ i 

Binary bitwise operations are performed on integer operands using the following symbols: 
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& bitwise AND 

| bitwise OR 

A bitwise exclusive OR 

< < arithmetic shift left (number of bits is operand) 

> > arithmetic shift right (number of bits is operand) 

The unaty bitwise NOT operator, which inverts all the bits in the operand, is imple- 
mented with the - symbol. For example, if i is declared as an unsigned int, then 
i = -0; sets i to the maximum integer value for an unsigned int. 

2.3.3 Combined Operators 

C allows operators to be combined with the assignment operator (=) so that almost any 
statement of the form 

<variable> = <variable> <operator> <expression> 

can be replaced with 

<variable> <operator> = <expression> 

where <variable> represents the same variable name in all cases. For example, the 
following pairs of expressions involving x and y perform the same function: 



X = X + y; 
x = x-y; 
X = x * y; 
x = X / y; 
X = X % y; 
X = x & y; 
x = x : y; 
X = X A y; 
X = x « y; 
X = X » y; 



X += y; 
X -= y; 
X *= y; 
X /= y; 
X %= y; 
X &- y; 
x := y; 
X A =f y; 
X «= y; 
X »= y; 



In many cases, the left-hand column of statements will result in a more readable and eas- 
ier to understand program. For this reason, use of combined operators is often avoided. 
Unfortunately, some compiler implementations may generate more efficient code if the 
combined operator is used. 



2.3.4 Logical Operators 

Like all C expressions, an expression involving a logical operator also has a value A log- 
ical operator is any operator that gives a result of true or false. This could be a compari- 
son between two values, or the result of a series of ANDs and ORs. If the result of a logi- 
cal operation is true, it has a nonzero value; if it is false, it has the value 0. Loops and if 
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statements (covered in section 2.4) check the result of logical operations and change pro- 
gram flow accordingly. The nine logical operators are as follows: 

< less than 

<= less than or equal to 

== equal to 

>= greater than or equal to 

> greater than 

i = not equal to 

&& logical AND 

| | logical OR 

! logical NOT (unary operator) 

Note that == can easily be confused with the assignment operator (=) and will result in a 
valid expression because the assignment also has a value, which is then interpreted as 
true or false. Also, && and | | should not be confused with their bitwise counterparts (& 
and | ) as this may result in hard to find logic problems, because the bitwise results may 
not give true or false when expected. 

2.3.5 Operator Precedence and Type Conversion 

Like all computer languages, C has an operator precedence that defines which operators in 
an expression are evaluated first. If this order is not desired, then parentheses can be used 
to change the order. Thus, things in parentheses are evaluated first and items of equal 
precedence are evaluated from left to right. The operators contained in the parentheses or 
expression are evaluated in the following order (listed by decreasing precedence): 



++, — 


increment, decrement 


- 


unary minus 




multiplication, division, modulus 


+ # - 


addition, subtraction 


<<, >> 


shift left, shift right 


<,<=,>=,> 


relational with less than or greater than 


==, ! = 


equal, not equal 


& 


bitwise AND 


A 


bitwise exclusive OR 


1 


bitwise OR 


&& 


logical AND 


1 1 


logical OR 



Statements and expressions using the operators just described should normally use vari- 
ables and constants of the same type. If, however, you mix types, C doesn’t stop dead 
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(like Pascal) or produce a strange unexpected result (like FORTRAN). Instead, C uses a 
set of rules to make type conversions automatically. The two basic rules are: 

(1) If an operation involves two types, the value with a lower rank is converted to the 
type of higher rank. This process is called promotion and the ranking from highest 
to lowest type is double, float, long, int, short, and char. Unsigned of each of the 
types outranks the individual signed type. 

(2) In an assignment statement, the final result is converted to the type of the variable 
that is being assigned. This may result in promotion or demotion where the value is 
truncated to a lower ranking type. 

Usually these rules work quite well, but sometimes the conversions must be stated 
explicitly in order to demand that a conversion be done in a certain way. This is accom- 
plished by type casting the quantity by placing the name of the desired type in parenthe- 
ses before the variable or expression. Thus, if i is an int, then the statement 
i=10* ( 1 . 55+1 . 67 ) ; would set i to 32 (the truncation of 32.2), while the statement 
i=10* ( (int) 1.55+1.67) ; would set i to 26 (the truncation of 26.7 since 
( int ) 1 . 55 is truncated to 1). 



2.4 PROGRAM CONTROL 

The large set of operators in C allows a great deal of programming flexibility for DSP ap- 
plications. Programs that must perform fast binary or logical operations can do so without 
using special functions to do the bitwise operations. C also has a complete set of program 
control features that allow conditional execution or repetition of statements based on the 
result of an expression. Proper use of these control structures is discussed in section 
2.11.2, where structured programming techniques are considered. 

2.4.1 Conditional Execution: if-else 

In C, as in many languages, the if statement is used to conditionally execute a series of 
statements based on the result of an expression. The if statement has the following 
generic format: 

if (value) 

statementl; 

else 

statement2 ; 

where value is any expression that results in (or can be converted to) an integer value. 
If value is nonzero (indicating a true result), then statementl is executed; otherwise, 
statement2 is executed. Note that the result of an expression used for value need 
not be the result of a logical operation — all that is required is that the expression results in 
a zero value when statement2 should be executed instead of statementl. Also, the 
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else statements ; portion of the above form is optional, allowing statementl tn 
be skipped if value is false. 0 

When more than one statement needs to be executed if a particular value is true a 
compound statement is used. A compound statement consists of a left brace ({), some 
number of statements (each ending with a semicolon), and a right brace (}). Note that the 
body of the main() program and functions in Listing 2.1 are compound statements. I n 
fact, a single statement can be replaced by a compound statement in any of the control 
structures described in this section. By using compound statements, the if-else con- 
trol structure can be nested as in the following example, which converts a floating-point 
number (result) to a 2-bit twos complement number (out): 



if(result > 0) { /* positive outputs */ 

if (result > sigma) 

ou t =1; /* biggest output */ 

else 

out =0; /* 0 < result <= sigma */ 

else 1 /* negative outputs */ 

if (result < sigma) 

out = 2; /* smallest output */ 

else 

out = 1; /* sigma <= result <= 0 */ 



Note that the inner if-else statements are compound statements (each consisting of two 
statements), which make the braces necessary in the outer if-else control structure (with- 
out the braces there would be too many else statements, resulting in a compilation error). 



2.4.2 The switch Statement 

When a program must choose between several alternatives, the if-else statement be- 
comes inconvenient and sometimes inefficient. When more than four alternatives from a 
single expression are chosen, the switch statement is very useful. The basic form of the 
switch statement is as follows: 

switch (integer expression) { 
case constantl: 

statements; (optional) 

break; (optional) 

case constant2 : 

statements; (optional) 

break; (optional) 

(more optional statements) 

default: (optional) 

statements; (optional) 



> 
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Program control jumps to the statement after the case label with the constant (an integer 
or single character in quotes) that matches the result of the integer expression in the 
switch statement. If no constant matches the expression value, control goes to the state- 
ment following the default label. If the default label is not present and no matching case 
labels are found, then control proceeds with the next statement following the switch 
statement. When a matching constant is found, the remaining statements after the corre- 
sponding case label are executed until the end of the switch statement is reached, or a 
break statement is reached that redirects control to the next statement after the switch 
statement. A simple example is as follows: 

switch (i) { 
case 0: 

print f ( " \nError : I is zero"); 
break; 
case 1: 

j = k*k; 
break; 
default : 

j = k*k/i; 

} 

The use of the break statement after the first two case statements is required in order to 
prevent the next statements from being executed (a break is not required after the last 
case or default statement). Thus, the above code segment sets j equal to k*k/i, 
unless i is zero, in which case it will indicate an error and leave j unchanged. Note that 
since the divide operation usually takes more time than the case statement branch, some 
execution time will be saved whenever i equals 1 . 

2.4.3 Single-Line Conditional Expressions 

C offers a way to express one if-else control structure in a single line. It is called a 
conditional expression, because it uses the conditional operator, ? : , which is the only tri- 
nary operator in C. The general form of the conditional expression is: 

expressionl ? expression2 : expression 

If expressionl is true (nonzero), then the whole conditional expression has the value 
of expression. If expressionl is false (0), the whole expression has the value of 
expression. One simple example is finding the maximum of two expressions: 

maxdif = ( a 0 > a2) ? aO-al : a2-al; 

Conditional expressions are not necessary, since if-else statements can provide the 
same function. Conditional expressions are more compact and sometimes lead to more 
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efficient machine code. On the other hand, they are often more confusing than the famil- 
iar if -else control structure. 

2.4.4 Loops: while, do-while, and for 

C has three control structures that allow a statement or group of statements to be repeated a 
fixed or variable number of times. The while loop repeats the statements until a test ex- 
pression becomes false, or zero. The decision to go through the loop is made before the 
loop is ever started. Thus, it is possible that the loop is never traversed. The general form is: 

while (expression) 
statement 

where statement can be a single statement or a compound statement enclosed in 
braces. An example of the latter that counts the number of spaces in a null-terminated 
string (an array of characters) follows: 

space_count =0; /* space_count is an int */ 

i = 0; /* array index, i = 0 */ 

while ( string ( i ] ) { 

if(string[i] == ' ' ) space_count++; . 
i++; /* next chair */ 

> 

Note that if the string is zero length, then the value of string [i] will initially point to 
the null terminator (which has a zero or false value) and the while loop will not be exe- 
cuted. Normally, the while loop will continue counting the spaces in the string until the 
null terminator is reached. 

The do-while loop is used when a group of statements need to be repeated and 
the exit condition should be tested at the end of the loop. The decision to go through the 
loop one more time is made after the loop is traversed so that the loop is always executed 
at least once. The format of do-while is similar to the while loop, except that the do 
keyword starts the statement and while (expression) ends the statement. A single 
or compound statement may appear between the do and the while keywords. A common 
use for this loop is in testing the bounds on an input variable as the following example il- 
lustrates: 

do { 

printf ( " \nEnter FFT length (less than 1025) :"); 
scanf ( "%d" , &f ft_length) ; 

} while (fft_length > 1024); 



In this code segment, if the integer f f t_length entered by the user is larger than 1024, 
the user is prompted again until the f f t_length entered is 1024 or less. 
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The for loop combines an initialization statement, an end condition statement, and 
an action statement (executed at the end of the loop) into one very powerful control struc- 
ture. The standard form is: 

for (initialize test condition ; end update) 
statement ; 

The three expressions are all optional (for ( ; ; ) ; is an infinite loop) and the statement may 
be a single statement, a compound statement or just a semicolon (a null statement). The most 
frequent use of the for loop is indexing an array through its elements. For example, 

for(i = 0 ; i < length ; i++) a[i] = 0; 

sets the elements of the array a to zero from a [0] up to and including a [length-1] . 
This for statement sets i to zero, checks to see if i is less than length, if so it exe- 
cutes the statement a [i] =0; , increments i, and then repeats the loop until i is equal to 
length. The integer i is incremented or updated at the end of the loop and then the test 
condition statement is executed. Thus, the statement after a for loop is only executed if 
the test condition in the for loop is true. For loops can be much more complicated, be- 
cause each statement can be multiple expressions as the following example illustrates: 

for(i = 0 , i3 = 1 ; i < 25 ; i++ , i3 = 3*13) 
printf ( “ \n%d %d” , i , i3 ) ; 

This statement uses two ints in the for loop (i, 13) to print the first 25 powers of 3. 
Note that the end condition is still a single expression (i < 25), but that the initialization 
and end expressions are two assignments for the two integers separated by a comma. 

2.4.5 Program Jumps: break, continue, and goto 

The loop control structures just discussed and the conditional statements (if, if-else, 
and switch) are the most important control structures in C. They should be used ex- 
clusively in the majority of programs. The last three control statements (break, 
continue, and goto) allow for conditional program jumps. If used excessively, they 
will make a program harder to follow, more difficult to debug, and harder to modify. 

The break statement, which was already illustrated in conjunction with the switch 
statement, causes the program flow to break free of the switch, for, while, or 
do-while that encloses it and proceed to the next statement after the associated control 
structure. Sometimes break is used to leave a loop when there are two or more reasons 
to end the loop. Usually, however, it is much clearer to combine the end conditions in a 
single logical expression in the loop test condition. The exception to this is when a large 
number of executable statements are contained in the loop and the result of some state- 
ment should cause a premature end of the loop (for example, an end of file or other error 
condition). 
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The continue statement is almost the opposite of break; the continue 
causes the rest of an iteration to be skipped and the next iteration to be started The 
continue statement can be used with for, while, and do-while loops, but cannot 
be used with switch. The flow of the loop in which the continue statement appears 
is interrupted, but the loop is not terminated. Although the continue statement can re- 
sult in very hard-to-follow code, it can shorten programs with nested if-else state- 
ments inside one of three loop structures. 

The goto statement is available in C, even though it is never required in C pro- 
gramming. Most programmers with a background in FORTRAN or BASIC computer lan- 
guages (both of which require the goto for program control) have developed bad pro- 
gramming habits that make them depend on the goto. The goto statement in C uses a 
label rather than a number making things a little better. For example, one possible legiti- 
mate use of goto is for consolidated error detection and cleanup as the following simple 
example illustrates: p 



program statements 



status - function_one (alpha, beta, constant) 
if (status != 0) goto error_exit; 



more program statements 



status = function_two (delta, time) ; 
if (status != 0) goto error_exit; 



error— exit : /*end up here from all errors */ 

switch (status) { 
case 1: 

printf ( 11 \nDivide by zero error\n" ) ; 
exit ( ) ; 
case 2 : 

printf (" \nOut of memory error \n " ) ; 
exit ( ) ; 
case 3 : 

printf (" \nLog overflow error\n") ; 
exit ( ) ; 
default : 

printf ( " \nUnknown error\n" ) 
exit ( ) ; 

} 



Sec. 2.5 Functions 



69 



In the above example, both of the fictitious functions, £unction_one and 
f unct ion_two (see the next section concerning the definition and use of functions), 
perform some set of operations that can result in one of several errors. If no errors are de- 
tected, the function returns zero and the program proceeds normally. If an error is de- 
tected, the integer status is set to an error code and the program jumps to the label 
error_exit where a message indicating the type of error is printed before the program 
is terminated. 



.5 FUNCTIONS 

All C programs consist of one or more functions. Even the program executed first is a 
function called main(), as illustrated in Listing 2.1. Thus, unlike other programming 
languages, there is no distinction between the main program and programs that are called 
by the main program (sometimes called subroutines). A C function may or may not re- 
turn a value thereby removing another distinction between subroutines and functions in 
languages such as FORTRAN. Each C function is a program equal to every other func- 
tion. Any function can call any other function (a function can even call itself), or be 
called by any other function. This makes C functions somewhat different than Pascal pro- 
cedures, where procedures nested inside one procedure are ignorant of procedures else- 
where in the program. It should also be pointed out that unlike FORTRAN and several 
other languages, C always passes functions arguments by value not by reference. Because 
arguments are passed by value, when a function must modify a variable in the calling 
program, the C programmer must specify the function argument as a pointer to the begin- 
ning of the variable in the calling program’s memory (see section 2.7 for a discussion of 
{winters). 

2.5.1 Defining and Declaring Functions 

A function is defined by the function type, a function name, a pair of parentheses contain- 
ing an optional formal argument list, and a pair of braces containing the optional exe- 
cutable statements. The general format for ANSI C is as follows: 

type name (formal argument list with declarations) 

{ 

function body 

> 

The type determines the type of value the function returns, not the type of arguments. If 
no type is given, the function is assumed to return an int (actually, a variable is also 
assumed to be of type int if no type specifier is provided). If a function does not return a 
value, it should be declared with the type void. For example. Listing 2.1 contains the 
function average as follows: 
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float average(float array[],int size) 

{ 

int i; 

float sum = 0.0; /* initialize and declare sum */ 

ford = 0 ; i < size ; i++) 

sum = sum + array [ i ] ; / * calculate sum * / 

return (sum/ size) ; /* return average */ 

} 

The first line in the above code segment declares a function called average will return 
a single-precision floating-point value and will accept two arguments. The two argument 
names (array and size) are defined in the formal argument list (also called the formal 
parameter list). The type of the two arguments specify that array is a one-dimensional 
array (of unknown length) and size is an int. Most modem C compilers allow the ar- 
gument declarations for a function to be condensed into the argument list. 

Note that the variable array is actually just a pointer to the beginning of the 
float: array that was allocated by the calling program. By passing the pointer, only one 
value is passed to the function and not the large floating-point array. In fact, the function 
could also be declared as follows: 

float average ( float ‘array, int size) 

This method, although more correct in the sense that it conveys what is passed to the 
function, may be more confusing because the function body references the variable as 

array [ i ] . 

The body of the function that defines the executable statements and local variables 
to be used by the function are contained between the two braces. Before the ending brace 
()), a return statement is used to return the float result back to the calling program. If 
the function did not return a value (in which case it should be declared void), simply 
omitting the return statement would return control to the calling program after the last 
statement before the ending brace. When a function with no return value must be termi- 
nated before the ending brace (if an error is detected, for example), a return; state- 
ment without a value should be used. The parentheses following the return statement are 
only required when the result of an expression is returned. Otherwise, a constant or vari- 
able may be returned without enclosing it in parentheses (for example, return 0 ; or 
return n;). 

Arguments are used to convey values from the calling program to the function. 
Because the arguments are passed by value, a local copy of each argument is made for 
the function to use (usually the variables are stored on the stack by the calling program). 
The local copy of the arguments may be freely modified by the function body, but will 
not change the values in the calling program since only the copy is changed. The return 
statement can communicate one value from the function to the calling program. Other 
than this returned value, the function may not directly communicate back to the calling 
program. This method of passing arguments by value, such that the calling program’s 
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variables are isolated from the function, avoids the common problem in FORTRAN 
where modifications of arguments by a function get passed back to the calling program, 
resulting in the occasional modification of constants within the calling program. 

When a function must return more than one value, one or more pointer arguments 
must be used. The calling program must allocate the storage for the result and pass the 
function a pointer to the memory area to be modified. The function then gets a copy of 
the pointer, which it uses (with the indirection operator, *, discussed in more detail in 
Section 2.7.1) to modify the variable allocated by the calling program. For example, the 
functions average and variance in Listing 2.1 can be combined into one function 
that passes the arguments back to the calling program in two float pointers called ave 
and var, as follows: 

void stats (float ‘array, int size, float *ave, float *var) 

( 

int i; 

float sum = 0.0; /* initialize sum of signal */ 

float sum2 = 0.0; /* sum of signal squared */ 

for(i = 0 ; i < size ; i++) I 

sum = sum + array[i]; /* calculate sums */ 
sum2 = sum2 + array [i] ‘array [i] ; 

} 

*ave = sum/size; /* pass average and variance */ 

*var = (sum2-sum* (*ave) )/ (size-1) ; 

} 

In this function, no value is returned, so it is declared type void and no return statement 
is used. This stats function is more efficient than the functions average and vari- 
ance together, because the sum of the array elements was calculated by both the average 
function and the variance function. If the variance is not required by the calling program, 
then the average function alone is much more efficient, because the sum of the squares of 
the array elements is not required to determine the average alone. 

2.5.2 Storage Class, Privacy, and Scope 

In addition to type, variables and functions have a property called storage class. There 
are four storage classes with four storage class designators: auto for automatic variables 
stored on the stack, extern for external variables stored outside the current module, 
static for variables known only in the current module, and register for temporary 
variables to be stored in one of the registers of the target computer. Each of these four 
storage classes defines the scope or degree of the privacy a particular variable or function 
holds. The storage class designator keyword (auto, extern, static, or register) 
must appear first in the variable declaration before any type specification. The privacy of 
a variable or function is the degree to which other modules or functions cannot access a 
variable or call a function. Scope is, in some ways, the complement of privacy because 
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Auto variables can only be declared within a function are created when r 
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o the function in which they are declared and do not retain their value from one invo^ 
tion of a function to another. Because auto variables are stored on a stack a funrf 
that uses omy auto variables can call itself recursively. The auto keyword is ram]! 
used ,n C programs, since variables declared within functions default to the auto storage 

o„iv TT’‘ diStinCti ° n ° f the auto sto «ge class is that an auto variable k 

only defined within the control structure that surrounds it. That is the scope of an a,,*- 

variable is limited to the expressions between the braces ({ and » containing the variabl^ 
declaration. For example, the following simple program would generate %££££ 
since 3 is unknown outside of the for loop: P ’ 



main() 

{ 



int i; 

for (i = 0 ; i < 10 ; i ++) { 

f nt /* declare j here */ 

1 = i*i; 
printf <"%d\j) ; 

1 

printf ("%d",j) ; /* j unknown here */ 



some !,!! ! VanabIes have the sa ™ scope as auto variables, but are stored in 
some type of register m the target computer. If the target computer does not have regis 
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les ctm be used to speed up program execution significantly. Most compilers limit the 
use of renter variables to pointers, integers, and characters, because tLeLrietma 
chines rarely have the ability to use registers for floating-point or double-precision opera- 

m . i”* 6 !!* 11 V3riables have the broadest scope. They are known to all functions in a 
module and are even known outside of the module in that they are declared Extern 
anables are stored in their own separate data area and must be declared outside of anv 

e T rn Variables mUSt be Careful n0t t0 cal1 diemseives 
or call other functions that access the same extern variables, since extern variables 

retain their values as functions are entered and exited. Extern is the default storage 

class for variables declared outside of functions and for the functions themselves Thus 

by s 0 ri„“ °o?r ise may be invoked by any functi ° n m a ^ - 
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Static variables differ from extern variables only in scope. A static vari- 
able declared outside of a function in one module is known only to the functions in that 
module. A static variable declared inside a function is known only to the function in 
which it is declared. Unlike an auto variable, a static variable retains its value from 
one invocation of a function to the next. Thus, static refers to the memory area as- 
signed to the variable and does not indicate that the value of the variable cannot be 
changed. Functions may also be declared static, in which case the function is only 
known to other functions in the same module. In this way, the programmer can prevent 
other modules (and, thereby, other users of the object module) from invoking a particular 
function. 

2.5.3 Function Prototypes 

Although not in the original definition of the C language, function prototypes, in one 
form or another, have become a standard C compiler feature. A function prototype is a 
statement (which must end with a semicolon) describing a particular function. It tells the 
compiler the type of the function (that is, the type of the variable it will return) and the 
type of each argument in the formal argument list. The function named in the function 
prototype may or may not be contained in the module where it is used. If the function is 
not defined in the module containing the prototype, the prototype must be declared exter- 
nal. All C compilers provide a series of header files that contain the function prototypes 
for all of the standard C functions. For example, the prototype for the stats function 
defined in Section 2.5.1 is as follows: 

extern void stats (float *, int, float *, float *) ,- 

This prototype indicates that stats (which is assumed to be in another module) returns 
no value and takes four arguments. The first argument is a pointer to a float (in this 
case, the array to do statsistics on). The second argument is an integer (in this case, giv- 
ing the size of the array) and the last two arguments are pointers to floats which will 
return the average and variance results. 

The result of using function prototypes for all functions used by a program is that 
the compiler now knows what type of arguments are expected by each function. This in- 
formation can be used in different ways. Some compilers convert whatever type of actual 
argument is used by the calling program to the type specified in the function prototype 
and issue a warning that a data conversion has taken place. Other compilers simply issue 
a warning indicating that the argument types do not agree and assume that the program- 
mer will fix it if such a mismatch is a problem. The ANSI C method of declaring func- 
tions also allows the use of a dummy variable with each formal parameter. In fact, when 
this ANSI C approach is used with dummy arguments, the only difference between func- 
tion prototypes and function declarations is the semicolon at the end of the function pro- 
totype and the possible use of extern to indicate that the function is defined in another 
module. 
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2.6 MACROS AND THE C PREPROCESSOR 

The C preprocessor is one of the most useful features of the C programming language. 
Although most languages allow compiler constants to be defined and used for conditional 
compilation, few languages (except for assembly language) allow the user to define 
macros. Perhaps this is why C is occasionally referred to as a portable macro assembly 
language. The large set of preprocessor directives can be used to completely change the 
look of a C program such that it is very difficult for anyone to decipher. On the other 
hand, the C preprocessor can be used to make complicated programs easy to follow, very 
efficient, and easy to code. The remainder of this chapter and the programs discussed in 
this book hopefully will serve to illustrate the latter advantages of the C preprocessor. 

The C preprocessor allows conditional compilation of program segments, user- 
defined symbolic replacement of any text in the program (called aliases as discussed in 
Section 2.6.2), and user-defined multiple parameter macros. All of the preprocessor di- 
rectives are evaluated before any C code is compiled and the directives themselves are re- 
moved from the program before compilation begins. Each preprocessor directive begins 
with a pound sign (#) followed by the preprocessor keyword. The following list indicates 
the basic use of each of the most commonly used preprocessor directives: 



#define NAME macro 


Associate symbol NAME with macro definition 
(optional parameters) 


tinclude "file" 


Copy named file (with directory specified) into 
current compilation 


#include <file> 


Include file from standard C library 


#if expression 


Conditionally compile the following code if result 

of expression is true 


#ifdef symbol 


Conditionally compile the following code if the 
symbol is defined 


#ifnde£ symbol 


Conditionally compile the following code if the 
symbol is not defined 


#else 


Conditionally compile the following code if the 
associated #if is not true 


#endif 


Indicates the end of previous #else, #if , 
#ifdef , or #ifndef 


#undef macro 


Undefine previously defined macro 



2.6.1 Conditional Preprocessor Directives 

Most of the above preprocessor directives are used for conditional compilation of por- 
tions of a program. For example, in the following version of the stats function (de- 
scribed previously in section 2.5.1), the definition of DEBUG is used to indicate that the 
print statements should be compiled: 
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void stats (float *array,int size, float *ave, float *var) 

{ 

int i ; 

float sum = 0.0; /* initialize sum of signal */ 

float sum2 =0.0; /* sum of signal squared */ 

for(i = 0 ; i < size ; 1++) { 
sum = sum + arrayli]; 

sum2 = sum2 + arrayli] * array] [i] ; /* calculate sums */ 

} 

#ifdef DEBUG 

printf("\nln stats sum = %f sum2 = %f ” , sum, sum2) ; 
printf ( "XnNumber of array elements = %d",size); 
tendif 

*ave = sum/size; /* pass average */ 

*var = (sum2 - sum* (*ave) )/ (size-1) ; /* pass variance */ 

} 

If the preprocessor parameter DEBUG is defined anywhere before the #i£de£ DEBUG 
statement, then the printf statements will be compiled as part of the program to aid in 
debugging stats (or perhaps even the calling program). Many compilers allow the defi- 
nition of preprocessor directives when the compiler is invoked. This allows the DEBUG 
option to be used with no changes to the program text. 

2.6.2 Aliases and Macros 

Of all the preprocessor directives, the #def ine directive is the most powerful because it 
allows aliases and multiple parameter macros to be defined in a relatively simple way. 
The most common use of #define is a macro with no arguments that replaces one 
string (the macro name) with another string (the macro definition). In this way, an alias 
can be given to any string including all of the C keywords. For example: 

#define DO for( 

replaces every occurrence of the string DO (all capital letters so that it is not confused 
with the C keyword do) with the four-character string for (. Similarly, new aliases of all 
the C keywords could be created with several #def ine statements (although this seems 
silly since the C keywords seem good enough). Even single characters can be aliased. For 
example, BEGIN could be aliased to { and END could be aliased to } , which makes a C 
program look more like Pascal. 

The #def ine directive is much more powerful when parameters are used to create 
a true macro. The above DO macro can be expanded to define a simple FORTRAN style 
DO loop as follows: 

#define DO(var,beg, end) for(var=beg; var<=end; var++) 
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™?* ree , " laCr ° P“ S Var ’ b69 ’ and the variable, the beginning va!„ 

and the ending value of the DO loop. In each case, the macro is invoked and the ’ 
placed in each argument is used to expand the macro. For example, ^ g 

DO(i,l,10) 

expands to 

for (i=l; i<=10; i++) 

rn iC A h ,i S th 7 a ' id , b f ginning of 3 f or ,0 °P that wiU start the variable i at 1 and stop it at 
10. Although this DO macro does shorten the amount of typing required to create such 1 
simple for loop, it must be used with caution. When macros are Ld wiA oSr oZl 

ihT’nhn^ maCrOS ’ ° r n other funct «>ns, unexpected program bugs can occur. For example 
tte alx>ve macro will not work at all with a pointer as the var argument, Se 

section 2 * 7 * n ' Th u Value and not the value it points to ( See 

lo^n rif the ‘ W ° P y reSUU in 3 Vety Strange number of cycles through the 
h h m7 6r terminated) - As “^cr example, consider the following cube 
macro, which will determine the cube of a variable: g 1138 

#define CUBE(x) (x) * <x) * (x) 

pand ^ C ( i+j )' ' ne fficiently) with CUBE (i +j) , since it would ex- 
(13 .) ( 13) However, CUBE(i ++) expands to <i ++ )*(i ++ ) 

vie wl?C»rxtSS" nted ~ d ” f »“ resullin 8 

t ? rna ° f conditional operator (see section 2.4.3) can be used with macro defini- 

mum ofT ™P lementat,ons of the absolute value of a variable (ABS), the mini- 

mum of two variables (MIN), the maximum of two variables (MAX), and the integer 
rounded value of a floating-point variable (ROUND) as follows: 8 

tdefine ABS (a) ( ( (a) < 0) ? <- a) : (a ) 

#define MAX(a,b) ( ( (a) > (b) ) ? ( a ) - (b) ) 

#define MIN(a,b) ( ( (a) < (b) ) ? (a) : ' (b) ) 

‘define ROUND (a) ( ( (a)<0) ?(int) ( (a)-0.5) (int) ( (a)+0.5) ) 

Note that each of the above macros is enclosed in parentheses so that it can be used freelv 
m expressions without uncertainty about the order of operations. Parentheses are also rl 

simpit rrr “* ™ cr ° paramews> “ ^ ^ ^ « wen „ 

All of the macros defined so far have names that contain only capital letters While 
“ not required, ,t does make it easy to separate macros from normal C k^rds 

r cros r ay T ? def,ned in one moduie and incM oi ^ 

#include directive) in another. This practice of capitalizing all macro names and using 
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lower case for variable and function names will be used in all programs in this book and 
on the accompanying disk. 

.7 POINTERS AND ARRAYS 

A pointer is a variable that holds an address of some data, rather than the data itself. The 
use of pointers is usually closely related to manipulating (assigning or changing) the ele- 
ments of an array of data. Pointers are used primarily for three purposes: 

(1) To point to different data elements within an array 

(2) To allow a program to create new variables while a program is executing (dynamic 
memory allocation) 

(3) To access different locations in a data structure 

The first two uses of pointers will be discussed in this section; pointers to data structures 
are considered in section 2.8.2. 

2.7.1 Special Pointer Operators 

Two special pointer operators are required to effectively manipulate pointers: the indi- 
rection operator (*) and the address of operator (&). The indirection operator (*) is used 
whenever the data stored at the address pointed to by a pointer is required, that is when- 
ever indirect addressing is required. Consider the following simple program: 

mainO 
{ 

int i, *ptr; 

1 = /* set the value of i */ 

ptr = &i; /* point to address of i */ 

printf ( " \n%d" , i) ; /* print i two ways */ 

printf ( " \n%d" , *ptr ) ; 

*ptr = 11; /* change i with pointer */ 

P r i n tf("\n%d %d”,*ptr,i); /* print change */ 

This program declares that i is an integer variable and that ptr is a pointer to an integer 
variable. The program first sets i to 7 and then sets the pointer to the address of i by the 
statement ptr=ti ; . The compiler assigns i and ptr storage locations somewhere in 
memory. At run time, ptr is set to the starting address of the integer variable i. The above 
program uses the function printf (see section 2.9.1) to print the integer value of i in two 
different ways— by printing the contents of the variable i (printf ( » \n%d" , i ) ; ), 
and by using the indirection operator (printf ( "\n%d", *ptr) ;). The presence of 
the * operator in front of ptr directs the compiler to pass the value stored at the address 
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ptr to the printf function (in this case, 7). If only ptr were used, then the address as- 
signed to ptr would be displayed instead of the value 7. The last two lines of the exam- 
pie illustrate indirect storage; the data at the ptr address is changed to 1 1. This results in 1 
changing the value of i only because ptr is pointing to the address of i. 

An array is essentially a section of memory that is allocated by the compiler and 
assigned the name given in the declaration statement. In fact, the name given is nothing 
more than a fixed pointer to the beginning of the array. In C, the array name can be used 
as a pointer or it can be used to reference an element of the array (i.e., a £2] ). If a is de- 
clared as some type of array then *a and a[0] are exactly equivalent. Furthermore, 

* (a+i) and a[i] are also the same (as long as i is declared as an integer), although 
the meaning of the second is often more clear. Arrays can be rapidly and sequentially ac- 
cessed by using pointers and the increment operator (++). For example, the following 
three statements set the first 100 elements of the array a to 10: 

int ‘pointer; 

pointer = a; 

forfi =0; i < 100 ; i++) *pointer++ = 10; 

On many computers this code will execute faster than the single statement for (i=0; 
i<100; i++) a [i] =10 ; , because the post increment of the pointer is faster than the 
array index calculation. 

2.7.2 Pointers and Dynamic Memory Allocation 

C has a set of four standard functions that allow the programmer to dynamically change 
the type and size of variables and arrays of variables stored in the computer’s memory. C 
programs can use the same memory for different purposes and not waste large sections of 
memory on arrays only used in one small section of a program. In addition, auto vari- 
ables are automatically allocated on the stack at the beginning of a function (or any sec- 
tion of code where the variable is declared within a pair of braces) and removed from the 
stack -when a function is exited (or at the right brace, }). By proper use of auto variables 
(see section 2.5.2) and the dynamic memory allocation functions, the memory used by a 
particular C program can be very little more than the memory required by the program at 
every step of execution. This feature of C is especially attractive in multiuser environ- 
ments where the product of the memory size required by a user and the time that memory 
is used ultimately determines the overall system performance. In many DSP applications, 
the proper use of dynamic memory allocation can enable a complicated DSP function to 
be performed with an inexpensive single chip signal processor with a small limited inter- 
nal memory size instead of a more costly processor with a larger external memory. 

Four standard functions are used to manipulate the memory available to a particular 
program (sometimes called the heap to differentiate it from the stack). Malloc allocates 
bytes of storage, calloc allocates items which may be any number of bytes long, free 
removes a previously allocated item from the heap, and realloc changes the size of a 
previously allocated item. 

When using each function, the size of the item to be allocated must be passed to the 
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function. The function then returns a pointer to a block of memory at least the size of the 
item or items requested. In order to make the use of the memory allocation functions 
portable from one machine to another, the built-in compiler macro sizeof must be 
used. For example: 

int *ptr; 

ptr = (int *) malloc (sizeof (int) ) ; 

allocates storage for one integer and points the integer pointer, ptr, to the beginning of 
the memory block. On 32-bit machines this will be a four-byte memory block (or one 
word) and on 16-bit machines (such as the IBM PC) this will typically be only two bytes. 
Because malloc (as well as calloc and realloc) returns a character pointer, it must 
be cast to the integer type of pointer by the (int *) cast operator. Similarly, calloc 
and a pointer, array, can be used to define a 25-element integer array as follows: 

int ‘array; 

array = (int *) calloc (25, sizeof (int) ) ; 

This statement will allocate an array of 25 elements, each of which is the size of an int 
on the target machine. The array can then be referenced by using another pointer (chang- 
ing the pointer array is unwise, because it holds the position of the beginning of the allo- 
cated memory) or by an array reference such as array [ i ] (where i may be from 0 to 
24). The memory block allocated by calloc is also initialized to zeros. 

Malloc, calloc, and free provide a simple general purpose memory allocation 
package. The argument to free (cast as a character pointer) is a pointer to a block previ- 
ously allocated by malloc or calloc; this space is made available for further alloca- 
tion, but its contents are left undisturbed. Needless to say, grave disorder will result if the 
space assigned by malloc is overrun, or if some random number is handed to free. 
The function free has no return value, because memory is always assumed to be hap- 
pily given up by the operating system. 

Realloc changes the size of the block previously allocated to a new size in bytes 
and returns a pointer to the (possibly moved) block. The contents of the old memory 
block will be unchanged up to the lesser of the new and old sizes. Realloc is used less 
than calloc and malloc, because the size of an array is usually known ahead of time. 
However, if the size of the integer array of 25 elements allocated in the last example must 
be increased to 100 elements, the following statement can be used: 

array = (int *) realloc( (char ‘Jarray, 100*sizeof (int) ) ; 

Note that unlike calloc, which takes two arguments (one for the number of items and 
one for the item size), realloc works similar to malloc and takes the total size of the 
array in bytes. It is also important to recognize that the following two statements are not 
equivalent to the previous realloc statement: 

free ( (char * ) array) ; 

array = (int *) calloc (100, sizeof (int) ) ; 
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These statements do change the size of the integer array from 25 to 100 elements but a 
not preserve the contents of the first 25 elements. In fact, calloc will initialize all inn 
integers to zero, while realloc will retain the first 25 and not set the remaining 7 ! 
array elements to any particular value. 6 0 

Unlike free, which returns no value, malloc, realloc, and calloc return 
null pointer ( 0 ) if there is no available memoiy or if the area has been corrupted by stnr 
ing outside the bounds of the memoiy block. When realloc returns 0, the bloc! 
pointed to by the original pointer may be destroyed. K 

2.7.3 Arrays of Pointers 

Any of the C data types or pointers to each of the data types can be declared as an arrav 
Arrays of pointers are especially useful in accessing large matrices. An array of pointers 
to 10 rows each of 20 integer elements can be dynamically allocated as follows: 

int *mat[10] ; 

int i; 

f° r (i = 0 ; i < 10 ; i++) { 

mat[i] = (int *) calloc (20, sizeof (int) ) ; 
if ( !mat[i] ) { 

printf ( ” \nError in matrix allocation^") ; 
exit(l) ; 

} 

} 

In this code segment, the array of 10 integer pointers is declared and then each pointer is 
se to 10 different memory blocks allocated by 10 successive calls to calloc After each 
call to the pointer must be checked to insure that the memory was available 

( mat [1] will be true if mat [1] is null). Each element in the matrix mat can now be 
accessed by using pointers and the indirection operator. For example, * (mat [ i ] + -j) 
gives the value of the matrix element at the ith row ( 0 - 9 ) and the jth column (0-19) and 
is exactly equivalent to mat [i][ j ] . In fact, the above code segment is equivalent (in 
the way mat may be referenced at least) to the array declaration int mat [ 10 ] 1201 • 
except that mat [ 10 ] [ 20 ] is allocated as an auto variable on the stack and the above 
calls to calloc allocates the space format on the heap. Note, however, that when mat 
is allocated on the stack as an auto variable, it cannot be used with free or realloc 
and may be accessed by the resulting code in a completely different way. 

The calculations required by the compiler to access a particular element in a two- 
dimensional matrix (by using matrix [ i ] [j], for example) usually take more instruc- 
tions and more execution time than accessing the same matrix using pointers. This is es- 
pecially true if many references to the same matrix row or column are required However, 
depending on the compiler and the speed of pointer operations on the target machine ac- 1 
cess to a two-dimensional array with pointers and simple pointers operands (even incre- 1 
ment and decrement) may take almost the same time as a reference to a matrix such as 1 
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a[i] [j]. For example, the product of two 100 x 100 matrices could be coded using 
two-dimensional array references as follows: 

int a[100] [100] ,b[100] [100] ,c[100] [100] ; /* 3 matrices */ 

int i,j,k, / * indices */ 

/ * code to set up mat and vec goes here * / 

/* do matrix multiply c = a * b */ 
for (i = 0 ; i < 100 ; j++) { 

for ( j = 0 ; j < 100 ; j++) { 
c[i] [j] = 0; 

for (k = 0 ; k < 100 ; k++) 

c[i][j] += a[i] [k] * b[k][j); 

) 

} 

The same matrix product could also be performed using arrays of pointers as follows: 

int a[100] [100] ,b[100] [100] ,c[100] [ 100 ] ; 
int *aptr, *bptr, *cptr; 
int i, j , k; 

/ * code to set up mat and vec goes here * / 

/* do c = a * b */ 
for (i = 0 ; i < 100 ; i++) { 
cptr = c [i] ; 
fcptr = b[0] ; 

for ( j = 0 ; j < 100 ; j++) { 
aptr = a[i] ; 

*cptr = (*aptr++) * (*bptr++) ; 
for (k = 1 ; k < 100; k++) { 

*cptr += (*aptr++) * b[k][j] ; 

) 

cptr++; 

> 

} 

The latter form of the matrix multiply code using arrays of pointers runs 10 to 20 percent 
taster, depending on the degree of optimization done by the compiler and the capabilities 
of the target machine. Note that c [i] and a [i] are references to arrays of pointers each 
pointing to 100 integer values. Three factors help make the program with pointers faster: 

(1) Pointer increments (such as *aptr++) are usually faster than pointer adds. 

(2) No multiplies or shifts are required to access a particular element of each matrix. 



/* 3 matrices */ 

/* pointers to a,b,c */ 
/* indicies */. 
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(3) The first add in the inner most loop (the one involving k) was taken outside the 
loop (using pointers aptr and bptr) and the initialization of c[i] [j] to zero 
was removed. 



2.8 STRUCTURES 

Pointers and arrays allow the same type of data to be arranged in a list and easily accessed 
by a program. Pointers also allow arrays to be passed to functions efficiently and dynami- 
cally created in memory. When unlike logically related data types must be manipulated, 
the use of several arrays becomes cumbersome. While it is always necessary to process 
the individual data types separately, it is often desirable to move all of the related data 
types as a single unit. The powerful C data construct called a structure allows new data 
types to be defined as a combination of any number of the standard C data types. Once the 
size and data types contained in a structure are defined (as described in the next section), 
the named structure may be used as any of the other data types in C. Arrays of structures, 
pointers to structures, and structures containing other structures may all be defined. 

One drawback of the user-defined structure is that the standard operators in C do not 
work with the new data structure. Although the enhancements to C available with the C++ 
programming language do allow the user to define structure operators (see The C++ 
Programming Language, Stroustrup, 1986), the widely used standard C language does not 
support such concepts. Thus, functions or macros are usually created to manipulate the 
structures defined by the user. As an example, some of the functions and macros required 
to manipulate structures of complex floating-point data are discussed in section 2.8.3. 

2.8.1 Declaring and Referencing Structures 

A structure is defined by a structure template indicating the type and name to be used to 
reference each element listed between a pair of braces. The general form of an N-element 
structure is as follows: 

struct tag_name { 

typel element_namel ; 
type2 element_name2 ; 



typeN element_nameN; 

} var iable_naine ; 

In each case, typel, type2, . . . , typeN refer to a valid C data type (char, int, 
float, or double without any storage class descriptor) and element_namel, 
element_name2, . . . , element nameN refer to the name of one of the elements 
of the data structure. The tag_name is an optional name used for referencing the struc- 
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ture later. The optional variable_name, or list of variable names, defines the names 
of the structures to be defined. The following structure template with a tag name of 
record defines a structure containing an integer called length, a float called 
sample_rate, a character pointer called name, and a pointer to an integer array called 

data: 

struct record { 
int length; 
float sample_rate ; 
char *name; 
int *data; 

} ; 

This structure template can be used to declare a structure called voice as follows: 

struct record voice; 

The structure called voice of type record can then be initialized as follows: 

voice. length = 1000; 
voice . sample_rate = 10.e3; 
voice.name = "voice signal"; 

The last element of the structure is a pointer to the data and must be set to the beginning 
of a 1000-element integer array (because length is 1000 in the above initialization). Each 
element of the structure is referenced with the form Btruct_jname . element. Thus, 
the 1000-element array associated with the voice structure can be allocated as follows: 

voice. data = (int *) calloc (1000, sizeof (int) ) ; 

Similarly, the other three elements of the structure can be displayed with the following 
code segment: 

printf ( " XnLength = %d" , voice . length) ; 

printf ( * XnSampling rate = %f" .voice. sairple_rate) ; 

printf (” \nRecord name = %s” .voice. name) ; 

A typedef statement can be used with a structure to make a user-defined data type and 
make declaring a structure even easier. The typedef defines an alternative name for the 
structure data type, but is more powerful than #def ine, since it is a compiler directive 
as opposed to a preprocessor directive. An alternative to the record structure is a 
typedef called RECORD as follows: 



typedef struct record RECORD; 
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This statement essentially replaces all occurrences of RECORD in the program with the 
struct record definition thereby defining a new type of variable called RECORD 
that may be used to define the voice structure with the simple statement RECORD voice • 
The typedef statement and the structure definition can be combined so that the 
tag name record is avoided as follows: 

typedef struct { 
int length ; 
float sample_rate ; 
char *name; 
int *data; 

} RECORD; 

In fact, the typedef statement can be used to define a shorthand form of any type of 
data type including pointers, arrays, arrays of pointers, or another typedef. For exam- 
ple, 

typedef char STRING [ 80 ] ; 

allows 80-character arrays to be easily defined with the simple statement STRING 
name 1 , name 2 ; . This shorthand form using the typedef is an exact replacement for 
the statement char namel [80] ,name2 [80] ;. 

2.8.2 Pointers to Structures 

Pointers to structures can be used to dynamically allocate arrays of structures and effi- 
ciently access structures within functions. Using the RECORD typedef defined in the 
last section, the following code segment can be used to dynamically allocate a five- 
element array of RECORD structures: 

RECORD * voices ; 

voices = (RECORD *) calloc (5, sizeof (RECORD) ) ; 



These two statements are equivalent to the single-array definition RECORD ' 
voices [ 5 ] ; except that the memory block allocated by calloc can be deallocated by 1 
a call to the free function. With either definition, the length of each element of the array i 
could be printed as follows: 1 

1 



int i; 5 

for (i = 0 ; i < 5 ; i++) 

print f ( " \nLength of voice %d = %d" , i, voices [i] . length) 

j 

1 he voices array can also be accessed by using a pointer to the array of structures. If \ 

voice_ptr is a RECORD pointer (by declaring it with RECORD *voice_ptr ; ), then I 
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( *voice_ptr) . length could be used to give the length of the RECORD which was 
pointed to by voice_ptr. Because this form of pointer operation occurs with structures 
often in C, a special operator (->) was defined. Thus, voice _ptr->length is equiv- 
alent to ( *voice_ptr) . length. This shorthand is very useful when used with func- 
tions, since a local copy of a structure pointer is passed to the function. For example the 
fofiowing function will print the length of each record in an array of RECORD of length 

void print_record_length (RECORD *rec,int size) 

{ 

int i; 

for(i = 0 ; i < size ; i++) { 

printf ( " \nLength of record %d = %d” , i,rec_>length) • 
rec++ ; 

} 

} 

Thus a statement like print_record length (voices, 5) ; will print the lengths 
stored in each of the five elements of the array of RECORD structures. 

2.8.3 Complex Numbers 

A complex number can be defined in C by using a structure of two floats and a 
typedef as follows: 

typedef struct { 
float real; 
float imag; 

} COMPLEX; 

Three complex numbers, x, y, and z can be defined using the above structure as follows: 

COMPLEX x,y, z; 

In order to perform the complex addition z = x + y without functions or macros the fol- 
lowing two C statements are required: 

z . real = x . real + y . real ; 
z . imag = x . imag + y . imag ; 

These two statements are required because the C operator + can only work with the indi- 
vidual parts of the complex structure and not the structure itself. In fact, a statement in- 
volving any operator and a structure should give a compiler error. Assignment of any 
structure (like z = x; ) works just fine, because only data movement is involved. A sim- 
ple function to perform the complex addition can be defined as follows: 
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COMPLEX cadd ( COMPLEX a, COMPLEX b) /* pass by value */ 

{ 

COMPLEX sum; /* define return value */ 
sum. real = a. real + b.real; 
sum.imag = a.imag + b.imag; 
return (sum) ; 

} 

This function passes the value of the a and b structures, forms the sum of a and b, and 
then returns the complex summation (some compilers may not allow this method of pass- 
ing structures by value, thus requiring pointers to each of the structures). The cadd func- 
tion may be used to set z equal to the sum of x and y as follows: 

z = cadd(x,y); 

The same complex sum can also be performed with a rather complicated single line 
macro defined as follows: 

#define CADD(a,b)\ 

( c_t . r eal =a . real +b . real , C_t . imag=a . imag+b . imag , C_t ) 

This macro can be used to replace the cadd function used above as follows: 

COMPLEX C_t; 

Z = CADD(z,y); 

This CADD macro works as desired because the macro expands to three operations separated 
by commas. The one-line macro in this case is equivalent to the following three statements: 

C_t.real = x.real + y.real; 

C_t.imag = x.imag + y.real; 
z = C_t; 



The first two operations in the macro are the two sums for the real and imaginary parts. 
The sums are followed by the variable C_t (which must be defined as COMPLEX before 
using the macro). The expression formed is evaluated from left to right and the whole ex- 
pression in parentheses takes on the value of the last expression, the complex structure 
C_t, which gets assigned to z as the last statement above shows. 

The complex add macro CADD will execute faster than the cadd function because 
the time required to pass the complex structures x and y to the function, and then pass the 
sum back to the calling program, is a significant part of the time required for the function 
call. Unfortunately, the complex add macro cannot be used in the same manner as the 
function. For example: 



COMPLEX a,b,c,d; 
d = cadd(a,cadd(b,c) ) ; 
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will form the sum d=a+b+c; as expected. However, the same format using the CADD 
macro would cause a compiler error, because the macro expansion performed by the C 
preprocessor results in an illegal expression. Thus, the CADD may only be used with sim- 
ple single- variable arguments. If speed is more important than ease of programming, then 
the macro form should be used by breaking complicated expressions into simpler two- 
operand expressions. Numerical C extensions to the C language support complex num- 
bers in an optimum way and are discussed in section 2.10.1. 



COMMON C PROGRAMMING PITFALLS 

The following sections describe some of the more common errors made by programmers 
when they first start coding in C and give a few suggestions how to avoid them. 

2.9.1 Array Indexing 

In C, all array indices start with zero rather than one. This makes the last index of a N 
long array AM. This is very useful in digital signal processing, because many of the ex- 
pressions for filters, z-transforms, and FFTs are easier to understand and use with the 
index starting at zero instead of one. For example, the FFT output for k = 0 gives the zero 
frequency (DC) spectral component of a discrete time signal. A typical indexing problem 
is illustrated in the following code segment, which is intended to determine the first 10 
powers of 2 and store the results in an array called power2 : 

int power 2 [10] ? 
int i,p; 

P = 1; 

for (i = 1 ; i<= 10 ; i++) { 
power2[i] = p; 

p = 2*p; 

> 

This code segment will compile well and may even run without any difficulty. The prob- 
lem is that the for loop index i stops on i=10, and power2 [10] is not a valid index 
to the power2 array. Also, the for loop starts with the index 1 causing power2 [0] to 
not be initialized. This results in the first power of two (2°, which should be stored in 
power2 [0] ) to be placed in power2 [1] . One way to correct this code is to change the 
for loop to read for (i = 0; i<10; i++) , so that the index to power2 starts at 0 
and stops at 9. 

2.9.2 Failure to Pass-by-Address 

This problem is most often encountered when first using scanf to read in a set of vari- 
ables. If i is an integer (declared as int if), then a statement like scanf ( "s&d" , i ) f 
is wrong because scanf expects the address of (or pointer to) the location to store the 
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integer that is read by scanf. The correct statement to read in the integer i 1 

S l Canf 1 < where the address of operator (&) was used to point to the addres! 

of x and pass the address to scaaf as required. On many compilers these types of errors 
can be detected and avoided by using function prototypes (see section 2.5.3) for all user 
written functions and the appropriate include files for all C library functions. By usino 
function prototypes, the compiler is informed what type of variable the function expect! 
and wdl issue a warning if the specified type is not used in the calling program. On many 
UNIX systems, a C program checker called LINT can be used to perform parameter-tvJ 
checking, as well as other syntax checking. ^ 

2.9.3 Misusing Pointers 

Because pointers are new to many programmers, the misuse of pointers in C can be par- 
ticularly difficult, because most C compilers will not indicate any pointer errors. Some 
compilers issue a warning for some pointer errors. Some pointer errors will result in the 
programs not working correctly or, worse yet, the program may seem to work, but will 
not work with a certain type of data or when the program is in a certain mode of opera- 
tion. On many small single-user systems (such as the IBM PC), misused pointers can eas- 
1 y result in writing to memory used by the operating system, often resulting in a system 
crash and requiring a subsequent reboot. 

There are two types of pointer abuses: setting a pointer to the wrong value (or not 
initializing it at all) and confusing arrays with pointers. The following code segment 
shows both of these problems- 



char ‘string; 
char msg[10] ; 
int i; 

printf ( " \nEnter title" ) ; 
scanf ( "%s" , string) ; 
i = 0; 

while (‘string != ' ') { 



i++; 

string++; 



msg=" Title = 

printf ("%s %s %d before space", msg, string, i); 

The first three statements declare that memory be allocated to a pointer variable called 1 
strxng, a 10-element char array called msg and an integer called i. Next, the user is 1 

asked to enter a title into the variable called string. The while loop is intended to 1 

search for the first space m the string and the last printf statement is intended to dis- 
play the string and the number of characters before the first space. j 

There are three pointer problems in this program, although the program will com- i 

pile with only one fatal error (and a possible warning). The fatal error message will refer- I 

ence the xasg= "Title = " ; statement. This line tells the compiler to set the address of 1 

the msg array to the constant string "Title =». This is not allowed so the error \ 
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“Lvalue required” (or something less useful) will be produced. The role of an arr „v * 
pointer have been confused and the msg variable should have been declared as a pointer 

The next problem with the code segment is that scanf will read the strinn into the 
ad^ss specified by fhe argu m e„, .tri w J™ « r 7i 7e» 

cution time could be anything (some compilers will set it to zero) which will nrnh w 
no. po,„, .o , place where d* Me sMng conld be 

finTrlr ll ’“ II” T” Ca " Cd * tri “ 3 l “™ '»«" nsed before it was de- 
med. The problem can be solved by initializing the string pointer to a memory area alln- 

° r f° nng the tltle strin g- The memory can be dynamically allocated by a simple 
call to calloc as shown in the following cotrected code segment P 

char ‘string, *msg; 
int i; 

string=calloc ( 80 , sizeof (char ) ) ■ 

printf (" \nEnter title"); 
scanf ( * %s " , string ) ■ 
i = 0; 

While (‘string != • ■ ) { 
i++; 

string++; 

) 

msg= "Title ="; 

printf ("%s %s %d before space” ,msg, string, i) ; 

r" T bUt WiH n0t give 1116 COITect response when a title 
g entered. In fact, the first characters of the title string before the first space will 

the T? bC “ USe the pointer strin 3 wa s moved to this point by the execution of 
the while loop. This may be useful for finding the first space in the while loop but re 
suits in the address of the beginning of die string being lost. Tt 7s test no ^ to Ini 
pointer which points to a dynamically allocated section of memory This pointer problem 
can be fixed by using another pointer (called cp) for the while |7 k, p as foTws! 

char ‘string, *cp, ‘msg; 
int i; 

string=calloc ( 80 , sizeof (char) ) ; 
printf (" \nEnter title" ) ; 

scanf ( “%s" , string) ; 
i = 0; 

cp = string; 
while(*cp != 1 ') { 
i++; 
cp++; 

} 

msg= "Title ="; 

printf ("%s %s %d before space", msg, string, i) ; 
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Another problem with this program segment is that if the string entered contains 
spaces, then the while loop will continue to search through memory until it f ln< j s 
space. On a PC, the program will almost always find a space (in the operating system 
haps) and will set i to some large value. On larger multiuser systems, this may result in 
fatal run-time error because the operating system must protect memory not allocated 
the program. Although this programming problem is not unique to C, it does illustrate 
important characteristic of pointers — pointers can and will point to any memory locati 
without regard to what may be stored there. 



10 NUMERICAL C EXTENSIONS 

Some ANSI C compilers designed for DSP processors are now available with numeric C 
extensions. These language extensions were developed by the ANSI NCEG (Numeric i 
Extensions Group), a working committee reporting to ANSI X3J1 1. This section gives an; 
overview of the Numerical C language recommended by the ANSI standards committee 
Numerical C has several features of interest to DSP programmers: 

(1) Fewer lines of code are required to perform vector and matrix operations. 

(2) Data types and operators for complex numbers (with real and imaginary compo-; 
nents) are defined and can be optimized by the compiler for the target processor.: 
This avoids the use of structures and macros as discussed in section 2.8.3. 

(3) The compiler can perform better optimizations of programs containing iteration^ 
which allows the target processor to complete DSP tasks in fewer instruction cycles. I 

2.10.1 Complex Data Types 

Complex numbers are supported using the keywords complex, creal, cimag, and: 
con j . These keywords are defined when the header file complex . h is included. There) 
are six integer complex types and three floating-point complex types, defined as shown iqj 
the following example: 

short int complex i; 

int conplex j ; j 

long int complex k; J 

unsigned short int complex ui; 
unsigned int complex uj ; 

unsigned long int complex uk; 1 

float complex x; | 

double complex y; 1 

long double complex z; 1 



The real and imaginary parts of the complex types each have the same representations 8 
the type defined without the complex keyword. Complex constants are represented as | 
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sum of a real constant and an imaginary constant, which is defined by using the suffix i 
after the imaginary part of the number. For example, initialization of complex numbers is 
performed as follows: 

short int complex i = 3 + 2i; 
float conplex x[3] = {1.0+2.0i, 3.0i, 4.0}; 

The following operators are defined for complex types: & (address of), * (point to com- 
plex number), + (add), - (subtract), * (multiply), / (divide). Bitwise, relational, and logi- 
cal operators are not defined. If any one of the operands are complex, the other 
operands will be converted to complex, and the result of the expression will be 
complex. The creal and cimag operators can be used in expressions to access the 
real or imaginary part of a complex variable or constant. The conj operator returns the 
complex conjugate of its complex argument. The following code segment illustrates these 
operators: 

float conplex a,b,c; 
creal (a) =1 . 0; 
cimag (a) =2 . Ch- 
oreal (b) =2 . 0*cimag (a) ; 
cimag (b) =3.0; 

c=conj (b) ; /* c will be 4 - 3i */ 

2.10.2 Iteration Operators 

Numerical C offers iterators to make writing mathematical expressions that are computed 
iteratively more simple and more efficient. The two new keywords are iter and sum. 
Iterators are variables that expand the execution of an expression to iterate the expression 
so that the iteration variable is automatically incremented from 0 to the value of the itera- 
tor. This effectively places the expression inside an efficient for loop. For example, the 
following three lines can be used to set the 10 elements of array ix to the integers 0 to 9: 

iter 1=10; 
int ix[10] ; 
ix[I]=I; 

The sum operator can be used to represent the sum of values computed from values of an 
iterator. The argument to sum must be an expression that has a value for each of the iter- 
ated variables, and the order of the iteration cannot change the result. The following code 
segment illustrates the sum operator: 

float a[10] ,b[10] ,c[10] ,d[10] [10] ,e[10] [10] , f [10] [10] ; 
float s; 

iter 1=10, J=10, K=10; 

s=sum(a [I] ) ; /* computes the sum of a into s */ 
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b[J]-sum(a[I]) ; /* sum of a calculated 10 times and stored 

in the elements of b */ 

c [J]=sum(d[I] [J] ) ; /* computes the sum of the column 

elements of d, the statement is 
iterated over J */ 

s=sum(d[I] [j] ) ; /* sums all the elements in d */ 

f [I] [J] =sum(d[I] [K] *e[K] [J] ) ; /* matrix multiply */ 
c [I]=sum(d[I] [K] *a[K] ) ; /* matrix * vector */ 



c [J]=sum(d[I] [J] ) ; 



s=sum(d[I] [j] ; 



II COMMENTS ON PROGRAMMING STYLE 



The four common measures of good DSP software are reliability, maintainability I 
sibility, and efficiency. y ’ X!e>f 4 

non A reliable P r °S ram is one seldom (if ever) fails. This is especially important J 
DSP because tremendous amounts of data are often processed using the same program wl 
die program fails due to one sequence of data passing through the program, it may be difl 
ficult, or impossible, to ever determine what caused the problem. i 

Since most programs of any size will occasionally fail, a maintainable program ; J 
one that is easy to fix. A truly maintainable program is one that can be fixed by someone 
other than the original programmer. It is also sometimes important to be able to maintain 
a program on more than one type of processor, which means that in order for a program 
to be truly maintainable, it must be portable. 

An extensible program is one that can be easily modified when the requirement! 
change, new functions need to be added, or new hardware features need to be exploited I 

An efficient program is often the key to a successful DSP implementation of a de-1 
sired function. An efficient DSP program will use the processing capabilities of the target 1 
computer (whether general purpose or dedicated) to minimize the execution time. In J 
typical DSP system this often means minimizing the number of operations per input sam-l 
pie or maximizing the number of operations that can be performed in parallel. In either! 
case, minimizing the number of operations per second usually means a lower overall sysl 
tem cost as fast computers typically cost more than slow computers. For example, ill 
could be said that the FFT algorithm reduced the cost of speech processing (both imple-J 
mentation cost and development cost) such that inexpensive speech recognition and gen-1 
eration processors are now available for use by the general public. i 

Unfortunately, DSP programs often forsake maintainability and extensibility for efJJ 
ticiency. Such is the case for most currently available programmable signal processing! 
integrated circuits. These devices are usually programmed in assembly language in suchal 
way that it is often impossible for changes to be made by anyone but the original pro! 
grammer, and after a few months even the original programmer may have to rewrite the ' 
program to add additional functions. Often a compiler is not available for the processor orf 
the processor’s architecture is not well suited to efficient generation of code from a com- 1 
ptled language. The current trend in programmable signal processors appears to be to! 
ward high-level languages. In fact, many of the DSP chip manufacturers are supplying Cl 
compilers for their more advanced products. 1 

U 
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2.11.1 Software Quality 

The four measures of software quality (reliability, maintainability, extensibility and effi- 
ciency) are rather difficult to quantify. One almost has to try to modify a program to find 
out if it is maintainable or extensible. A program is usually tested in a finite number of 
ways much smaller than the millions of input data conditions. This means that a program 
can be considered reliable only after years of bug-free use in many different environ- 
ments. 

Programs do not acquire these qualities by accident. It is unlikely that good pro- 
grams will be intuit. vely created just because the programmer is clever, experienced, or 
uses lots of comments. Even the use of structured-programming techniques (described 
briefly in the next section) will not assure that a program is easier to maintain or extend. 
It is the author s experience that the following five coding situations will often lessen the 

software quality of DSP programs: 

(1) Functions that are too big or have several purposes 

(2) A main program that does not use functions 

(3) Functions that are tightly bound to the main program 

(4) Programming “tricks” that are always poorly documented 

(5) Lack of meaningful variable names and comments 

An oversized function (item 1) might be defined as one that exceeds two pages of source 
listing. A function with more than one purpose lacks strength. A function with one clearly 
defined putpose can be used by other programs and other programmers. Functions with 
many purposes will find limited utility and limited acceptance by others. All of the func- 
tions described m this book and contained on the included disk were designed with this 
important consideration in mind. Functions that have only one purpose should rarely ex- 
ceed one page. This is not to say that all functions will be smaller than this. In time- 
cntical DSP applications, the use of in-line code can easily make a function quite long 
but can sometimes save precious execution time. It is generally true, however, that big 
programs are more difficult to understand and maintain than small ones. 

A mam program that does not use functions (item 2) will often result in an ex- 
tremely long and hard-to-understand program. Also, because complicated operations 
often can be independently tested when placed in short functions, the program may be 
easier to debug. However, taking this rule to the extreme can result in functions that are 
tightly bound to the main program, violating item 3. A function that is tightly bound to 
he rest of the program (by using too many global variables, for example) weakens the 
entire program. If there are lots of tightly coupled functions in a program, maintenance 
becomes impossible. A change in one function can cause an undesired, unexpected 

change m the rest of the functions. 

Clever programming tricks (item 4) should be avoided at all costs as they will often 
no be reliable and will almost always be difficult for someone else to understand (even 
with lots of comments). Usually, if the program timing is so close that a trick must be 
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used, then the wrong processor was chosen for the application. Even if the progr 
trick solves a particular timing problem, as soon as the system requirements change 
they almost always do), a new timing problem without a solution may soon develop. 

A program that does not use meaningful variables and comments (item 5) is 
anteed to be very difficult to maintain. Consider the following valid C program: 

main ( ) { int _o_oo_, _ooo ; for (_o_oo =2 ; ; o o ++ ) 

{ for ( ooo_=2 ; o oo % ooo_ ! =0 ; ooo_++ ; 

if ( ooo_==_o_oo )printf ( " \n%d" ,_o__oo___) ; } } 

Even the most experienced C programmer would have difficulty determining what 
three-line program does. Even after running such a poorly documented program, it 
be hard to determine how the results were obtained. The following program does ex 
the same operations as the above three lines but is easy to follow and modify: 

main ( ) 

{ 

int prime_test, divisor; 

/* The outer for loop trys all numbers >1 and the inner 
for loop checks the number tested for any divisors 
less than itself. V 

f or (prime_test = 2 ; ; prime_test++) { 

for (divisor = 2 ; prime_test % divisor != 0 ; divisor++) ; 
if (divisor == prime_test) printf ( ”\n%d” ,prime_test) ; 

} 



It is easy for anyone to discover that the above well-documented program prints a list) 
prime numbers, because the following three documentation rules were followed: 

(1) Variable names that are meaningful in the context of the program were used. A 
variable names such as x,y,z or i,j,k, unless they are simple indexes used 
very obvious way, such as initializing an entire array to a constant. 

(2) Comments preceded each major section of the program (the above program 
has one section). Although the meaning of this short program is fairly clear wi 
the comments, it rarely hurts to have too many comments. Adding a blank line 
tween different parts of a program also sometimes improves the readability t. 
program because the different sections of code appear separated from each others; 

(3) Statements at different levels of nesting were indented to show which control s 
ture controls the execution of the statements at a particular level. The author pr 
to place the right brace ( {) with the control structure (for, while, if, etc.) affi 
place the left brace (}) on a separate line starting in the same column as the b< 
ning of the corresponding control structure. The exception to this practice i 
function declarations where the right brace is placed on a separate line after the 
gument declarations. 
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2.11.2 Structured Programming 

Structured programming has developed from the notion that any algorithm, no matter 
how complex, can be expressed by using the programming-control structures if-else, 
while, and sequence. All programming languages must contain some representation of 
these three fundamental control structures. The development of structured programming 
revealed that if a program uses these three control structures, then the logic of the pro- 
gram can be read and understood by beginning at the first statement and continuing 
downward to the last. Also, all programs could be written without goto statements. 
Generally, structured-programming practices lead to code that is easier to read, easier to 
maintain, and even easier to write. 

The C language has the three basic control structures as well as three additional 
structured-programming constructs called do-while, for, and case. The additional three 
control structures have been added to C and most other modem languages because they 
are convenient, they retain the original goals of structured programming, and their use 
often makes a program easier to comprehend. 

The sequence control structure is used for operations that will be executed once in a 
function or program in a fixed sequence. This structure is often used where speed is most 
important and is often referred to as in-line code when the sequence of operations are 
identical and could be coded using one of the other structures. Extensive use of in-line 
code can obscure the purpose of the code segment. 

The if-else control structure in C is the most common way of providing conditional 
execution of a sequence of operations based on the result of a logical operation. Indenting 
of different levels of if and else statements (as shown in the example in section 2.4.1) 
is not required; it is an expression of C programming style that helps the readability of the 
if-else control structure. Nested while and for loops should also be indented for im- 
proved readability (as illustrated in section 2.7.3). 

The case control structure is a convenient way to execute one of a series of opera- 
tions based upon the value of an expression (see the example in section 2.4.2). It is often 
used instead of a series of if-else structures when a large number of conditions are tested 
based upon a common expression. In C, the switch statement gives the expression to 
test and a series of case statements give the conditions to match the expression. A 
default statement can be optionally added to execute a sequence of operations if none 
of the listed conditions are met. 

The last three control structures (while, do-while, and for) all provide for repeating 
a sequence of operations a fixed or variable number of times. These loop statements can 
make a program easy to read and maintain. The while loop provides for the iterative ex- 
ecution of a series of statements as long as a tested condition is true; when the condition 
is false, execution continues to the next statement in the program. The do-while con- 
trol structure is similar to the while loop, except that the sequence of statements is exe- 
cuted at least once. The for control structure provides for the iteration of statements 
with automatic modification of a variable and a condition that terminates the iterations. 
For loops are more powerful in C than most languages. C allows for any initializing 
; ,statement, any iterating statement and any terminating statement. The three statements do 
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not need to be related and any of them can be a null statement or multiple state™ 1 
folknvmg three examples of while, do-while, and for loops all calcuhST'l 
of two of an integer i (assumed to be greater than 0) and set the result to k ^ 
loop is as follows: ‘he 



k - 2; /* while loop k=2**i */ 

while ( i > 0) { 
k = 2*k; 



The do-while loop is as follows: 



k - 1; /* do-while loop k = 2**i */ 

do { 

k = 2*k; 
i ; 

} while (i > 0) ; 



The for loop is as follows: 



for (k = 2 ; i > 1 ; i ) ;j 

k = 2*k; /* for loop k=2**i */ 

Which form of loop to use is a personal matter. Of the three equivalent code semen 

“J C ’ / T l0 ° P r d thC WhilS l0 ° P b °* h SCem eas > to understand and W 
probably be preferred over the do-while construction. 

The C language also offers several extensions to the six structured programmii 

Bre^l^d* ' CS . f™ 0 ” 8 theSe 316 break - continue, and goto (see section ^ 
Break and continue statements allow the orderly interruption of events that are ex, 
cuting inside of loops. They can often make a complicated loop very difficult to folloi 
because more than one condition may cause the iterations to stop. The infamous got 

m ent men rh IS fh a S °a lnC “ C ' Nearly eVery language designer includes a goto stall 

St^s^l U Sh ° Uld 1,6 a '° ng With “ exam P le of H 

enrl„sI!) C h P T 8ram eXamples the followin g chapters and the programs contained on tl 
enclosed disk were developed by using structured-programming practices. The code d 

be read from top to bottom, there are no goto statements, and the six accepted coni 

rr S f 0ne . reqU,remen t of structured programming that was not adopj 

tluoughout the software m this book is that each program and function have only | 
try and exit point. Although every function and program does have only one enl 
point (as is required ,n C), many of the programs and functions have multiple exit po 
Typically this is done in order to improve the readability of the program. For examp 
error conditions in a main program often require terminating the program premature 
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after displaying an error message. Such an error-related exit is performed by calling the C 
library function exit (n) with a suitable error code, if desired. Similarly, many of the 
functions have more than one return statement as this can make the logic in a function 
much easier to program and in some cases more efficient. 
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DSP Microprocessors 
in Embedded Systems 



The term embedded system is often used to refer to a processor and associated circuits 
required to perform a particular function that is not the sole purpose of the overall sys- 
tem. For example, a keyboard controller on a computer system may be an embedded 
system if it has a processor that handles the keyboard activity for the computer system. 
In a similar fashion, digital signal processors are often embedded in larger systems to 
perform specialized DSP operations to allow the overall system to handle general pur- 
pose tasks. A special purpose processor used for voice processing, including analog-to- 
digital (A/D) and digital-to-analog (D/A) converters, is an embedded DSP system when 
it is part of a personal computer system. Often this type of DSP runs only one appli- 
cation (perhaps speech synthesis or recognition) and is not programmed by the end user. 
The fact that the processor is embedded in the computer system may be unknown to 
the end user. 

A DSP’s data format, either fixed-point or floating-point, determines its ability 
to handle signals of differing precision, dynamic range, and signal-to-noise ratios. 
Also, ease-of-use and software development time are often equally important when 
deciding between fixed-point and floating-point processors. Floating-point processors 
are often more expensive than similar fixed-point processors but can execute more 
instructions per second. Each instruction in a floating-point processor may also be 
more complicated, leading to fewer cycles per DSP function. DSP microprocessors can 
be classified as fixed-point processors if they can only perform fixed-point multi- 
plies and adds, or as floating-point processors if they can perform floating-point oper- 
ations. 
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The precision of a particular class of A/D and D/A converters (classified in terms 
of cost or maximum sampling rate) has been slowly increasing at a rate of about one 
bit every two years. At the same time the speed (or maximum sampling rate) has also 
been increasing. The dynamic range of many algorithms is higher at the output than at 
the input and intermediate results are often not constrained to any particular dynamic 
range. This requires that intermediate results be scaled using a shift operator when a 
fixed-point DSP is used. This will require more cycles for a particular algorithm in 
fixed-point than on an equal floating-point processor. Thus, as the A/D and D/A re- 
quirements for a particular application require higher speeds and more bits, a 
fixed-point DSP may need to be replaced with a faster processor with more bits. Also, 
the fixed-point program may require extensive modification to accommodate the greater 
precision. 

In general, floating-point DSPs are easier to use and allow a quicker time-to- 
market than processors that do not support floating-point formats. The extent to which 
this is true depends on the architecture of the floating-point processor. High-level lan- 
guage programmability, large address spaces, and wide dynamic range associated with 
floating-point processors allow system development time to be spent on algorithms and 
signal processing problems rather than assembly coding, code partitioning, quantization 
error, and scaling. In the remainder of this chapter, floating-point digital signal proces- 
sors and the software required to develop DSP algorithms are considered in more de- 



1.1 TYPICAL FLOATING-POINT DIGITAL SIGNAL PROCESSORS 

This section describes the general properties of the following three floating-point DSP 
processor families: AT&T DSP32C and DSP3210, Analog Devices ADSP-21020 and 
ADSP-21060, and Texas Instruments TMS320C30 and TMS320C40. The information 
was obtained from the manufacturers’ data books and manuals and is believed to be an 
accurate summary of the features of each processor and the development tools available. 
Detailed information should be obtained directly from manufacturers, as new features are 
constantly being added to their DSP products. The features of the three processors are 
summarized in sections 3.1.1, 3.1.2, and 3.1.3. 

The execution speed of a DSP algorithm is also important when selecting a proces- 
sor. Various basic building block DSP algorithms are carefully optimized in assembly 
language by the processor’s manufacturer. The time to complete a particular algorithm is 
often called a benchmark. Benchmark code is always in assembly language (sometimes 
without the ability to be called by a C function) and can be used to give a general mea- 
sure of the maximum signal processing performance that can be obtained for a particular 
processor. Typical benchmarks for the three floating-point processor families are shown 
in the following table. Times are in microseconds based the on highest speed processor 
available at publication time. 
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I Maximum Instruction 

Cycle Speed (MIPs) 20 40 20 3o 

1024 Complex cycles 1613 11* 19245 40457 

FFT with bitreverse time 2016.4 481.13 2022.85 VwT- 

PIR Filter cycles 187* 44 ^ 

(35 Taps) time 2.34 T1 Z25 TT~ 

IIR Filter cycles 85* 14 23 

(2 Biquads) time F06 0.35 L15 

4x4 * 4x1 cycles 80* 24 jg — 

Matrix Multiply time 1.0 06 Z9 

*Cycle counts for DSP32C and DSP3210 are clock cycles including wait states (1 instruction = 4 clock r 
cles). c 



3.1.1 AT&T DSP32C and DSP3210 

Figure 3.1 shows a block diagram of the DSP32C microprocessor manufactured by 
AT&T (Allentown, PA). The following is a brief description of this processor provided 
by AT&T. 

The DSP32C’s two execution units, the control arithmetic unit (CAU) and the data 
arithmetic unit (DAU), are used to achieve the high throughput of 20 million instruc- 
tions per second (at the maximum clock speed of 80 MHz). The CAU performs 16- or 
24 -bit mteger arithmetic and logical operations, and provides data move and control ca- 
pabilities. This unit includes 22 general purpose registers. The DAU performs 32-bit 
floating-point arithmetic for signal processing functions. It includes a 32-bit floating- 
point multiplier, a 40-bit floating-point adder, and four 40-bit accumulators. The multi- 
plier and the adder work in parallel to perform 25 million floating-point computations 
per second. The DAU also incorporates special-purpose hardware for data-type conver- 
sions. 

On-chip memory includes 1536 words of RAM. Up to 16 Mbytes of external mem- 
ory can be directly addressed by the external memory interface that supports wait states 
and bus arbitration. All memory can be addressed as 8-, 16- or 32-bit data, with the 32-bit 
data being accessed at the same speed as 8- or 16-bit data. 

The DSP32C has three I/O ports: an external memory port, a serial port and a 16-bit 
parallel port. In addition to providing access to commercially available memory, the ex- 
ternal memory interface can be used for memory mapped I/O. The serial port can inter- 
face to a time division multiplexed (TDM) stream, a codec, or another DSP32C. The par- 
allel port provides an interface to an external microprocessor. In summary, some of the 
key features of the DSP32C follow. 




LEGEND 
A0-*-A3 Accumulator* 0—3 

ALU Arithmetic logic unit 

CAU Control arthmetic unit 

DAU Data arithmetic unit 

0AUC DAU confrol register 

EMR Error mask register 

ESR Error sourceregister 

®UF Input buffer 

*OC Input/output control register 

® Insbuction register 

Instruction register pipeline 
For a detailed description, see Architecture. 



Input shift register 
Interrupt vector table pointer 
Output buffer 
Output shift register 
PIO address register 
PKD address register extended 
Program counter 
PIO control register 
Processor control word 
PIO data register 



PDR2 PIO data register 2 

PIN Serial DMA input pointer 

PIO Parallel I/O unit 

PIOP Parallel I/O port register 

PIR PIO interrupt register 

POUT Serial DM output pointer 

R1—R19 Registers 1—19 

RAM Read/write memory 

ROM Read-only memory 

SIO Serial I/O unit 



FIGURE 3.1 Block diagram of DSP32C processor (Courtesy AT&T). 
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KEY FEATURES 

• 63 instructions, 3-stage pipeline 

• Full 32-bit floating-point architecture for increased precision and dynamic range 

• Faster application evaluation and development yielding increased market leverage 

• Single cycle instructions, eliminating multicycle branches 

• Four memory accesses/instruction for exceptional memory bandwidth 

• Easy-to-leam and read C-like assembly language 

• Serial and parallel ports with DMA for clean external interfacing 

• Single-instruction data conversion for IEEE P754 floating-point, 8-, 16-, and 24-bit 
integers, p-law, A-Law and linear numbers 

• Fully vectored interrupts with hardware context saving up to 2 million interrupts 
per second 

• Byte-addressable memory efficiently storing 8- and 16-bit data 

• Wait-states of 1/4 instruction increments and two independent external memory 
speed partitions for flexible, cost-efficient memory configurations 

DESCRIPTION OF AT&T HARDWARE DEVELOPMENT HARDWARE 

• Full-speed operation of DSP32C (80 MHz) 

• Serial I/O through an AT&T T7520 High Precision Codec with mini-BNC connec- 
tors for analog input and output 

• Provision for external serial I/O through a 34-pin connector 

• Upper 8-bits of DSP32C parallel I/O port access via connector 

• DSP32C Simulator providing an interactive interface to the development system. 

• Simulator-controlled software breakpoints; examining and changing memory con- 
tents or device registers 

Figure 3.2 shows a block diagram of the DSP3210 microprocessor manufactured by 
AT&T. The following is a brief description of this processor provided by AT&T. 

AT&T DSP3210 DIGITAL SIGNAL PROCESSOR FEATURES 

• 16.6 million instructions per second (66 MHz clock) 

• 63 instructions, 3-stage pipeline 

• Two 4-kbyte RAM blocks, 1 -kbyte boot ROM 

• 32-bit barrel shifter and 32-bit timer 

• Serial I/O port, 2 DMA channels, 2 external interrupts 

• Fall 32-bit floating-point arithmetic for fast, efficient software development 

• C-like assembly language for ease of programming 

• All single-cycle instructions; four memory accesses/instruction cycle 

• Hardware context save and single-cycle PC relative addressing 
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CAU Control Arithmetic Unit 


SIO 
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FIGURE 3.2 Block diagram of DSP3210 processor (Courtesy AT&T). 
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• Microprocessor bus compatibility (The DSP3210 is designed for efficient bus 

S"de™™ a " OW ‘ DSP32 ' 0 “ i "“^ ra,ed 

• 32-bit, byte-addressable address space allowing the DSP3210 and a micronroce«„ 

to share the same address space and to share pointer values. r 

• Retry, relinquish/retry, and bus error support 

• Page mode DRAM support 

• Direct support for both Motorola and Intel signaling 

AT&T DSP3210 FAMILY HARDWARE DEVELOPMENT SYSTEM DESCRIPTION 

The MP3210 implements one or two AT&T DSP3210 32-bit floating-point DSPs with , 

MPtCTTr ""VI mem0iy ’ digital V ° and Passional audio signal I/O. The 
MP3210 holds up to 2 Mbytes of dynamic RAM (DRAM). The DT-Connect interface en 

ables real-time video I/O. MP3210 systems include: the processor card; C Host drivers 

*e AT&T DSP 32 io°r’ "S Uti, * ties ’ with source code ’ User ’ s Manual; and 
die AT&T DSP3210 Information Manual. DSP3210 is the low-cost Multimedia 

Processor of Choice. New features added to the DSP3210 are briefly outlined below 



DSP3210 FEATURES 

• Speeds up to 33 MFLOPS 

• 2k x 32 on-chip RAM 

• Full, 32-bit, floating-point 

• All instructions are single cycle 

• Four memory accesses per 
instruction cycle 

• Microprocessor bus compatibility 

• 32-bit byte-addressable designs. 

• Retry, relinquish/retry 

• error support 

• Boot ROM 

• Page mode DRAM support 

• Directly supports 680X0 
and 80X86 signaling 



USER BENEFITS 

The high performance and large on-chip 
memory space enable 
fast, efficient processing of complex algo- 
rithms. 

Ease of programming/higher performance. 

Higher performance. 

Designed for efficient bus master. 

This allows the DSP3210 address space to 
easily be incorporated into pP 
bus-based designs. The 32-bit, byte- 
addressable space allows the 
DSP3210 and a gP to share the same 
address space and to share pointer 
values as well. 



3.1.2 Analog Devices ADSP-210XX 



Figure 33 shows a block diagram of the ADSP-21020 microprocessor manufactured by 

^P^fnon Ce 4 ( r^ 0Od ’ MA) ’ ^ ADSP - 21060 core processor is similar to the 
ADSP-21020 The ADSP-21060 (Figure 3.4) also includes a large on-chip memory, a 

DMA controller, senal ports, link ports, a host interface and multiprocessing features 
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FIGURE 3.3 Block diagram of ADSP-21020 processor (Courtesy Analog Devices.) 
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FIGURE 3.4 Block diagram of ADSP-21060 processor (Courtesy Analog Devices.) 
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with the core processor. The following is a brief description of these processors provided 
by Analog Devices. 

The ADSP-210XX processors provide fast, flexible arithmetic computation units, 
unconstrained data flow to and from the computation units, extended precision and dy- 
namic range in the computation units, dual address generators, and efficient program se- 
quencing. All instructions execute in a single cycle. It provides one of the fastest cycle 
times available and the most complete set of arithmetic operations, including seed 1/x, 
min, max, clip, shift and rotate, in addition to the traditional multiplication, addition, sub- 
traction, and combined addition/subtraction. It is IEEE floating-point compatible and al- 
lows interrupts to be generated by arithmetic exceptions or latched status exception han- 
dling. 

The ADSP-210XX has a modified Harvard architecture combined with a 10-port 
data register file. In every cycle two operands can be read or written to or from the regis- 
ter file, two operands can be supplied to the ALU, two operands can be supplied to the 
multiplier, and two results can be received from the ALU and multiplier. The processor’s 
48-bit orthogonal instruction word supports fully parallel data transfer and arithmetic op- 
erations in the same instruction. 

The processor handles 32-bit IEEE floating-point format as well as 32-bit integer 
and fractional formats. It also handles extended precision 40-bit IEEE floating-point for- 
mats and carries extended precision throughout its computation units, limiting data trun- 
cation errors. 

The processor has two data address generators (DAGs) that provide immediate or 
indirect (pre- and post-modify) addressing. Modulus and bit-reverse addressing opera- 
tions are supported with no constraints on circular data buffer placement. In addition to 
zero-overhead loops, the ADSP-210XX supports single-cycle setup and exit for loops. 
Loops are both nestable (six levels in hardware) and interruptable. The processor sup- 
ports both delayed and nondelayed branches. In summary, some of the key features of the 
ADSP-210XX core processor follow: 

• 48-bit instruction, 32/40-bit data words 

• 80-bit MAC accumulator 

• 3-stage pipeline, 63 instruction types 

• 32 x 48-bit instruction cache 

• 10-port, 32 x 40-bit register file (16 registers per set, 2 sets) 

• 6-level loop stack 

• 24-bit program, 32-bit data address spaces, memory buses 

• 1 instruction/cycle (pipelined) 

• 1 -cycle multiply (32-bit or 40-bit floating-point or 32-bit fixed-point) 

• 6-cycle divide (32-bit or 40-bit floating-point) 

• 2-cycle branch delay 

• Zero overhead loops 

• Barrel shifter 







